00000100:00100000:0.0F:1789891159.939593:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1876835061143040:0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.939664:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1789891159.939672:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c684762-cb06-47df-8ceb-1f58f3195acf:3294:1876835061142656:0@lo:400:kworker.0 00000100:00100000:3.0F:1789891159.939735:0:72921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143040 00000100:00100000:3.0:1789891159.939755:0:72921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143040 00000100:00100000:0.0:1789891159.939763:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1876835061142912:0@lo:400:kworker.0 00000100:00100000:1.0:1789891159.939767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891159.939834:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891159.939846:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061143168:0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.939869:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789891159.939875:0:72921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1789891159.939880:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061142784:0@lo:400:kworker.0 00000100:00100000:1.0:1789891159.939893:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891159.939900:0:72921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3293:x1876835061143040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.939933:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891159.939954:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061142656 00000100:00100000:1.0:1789891159.939960:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061142656 00000100:00100000:0.0:1789891159.939971:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061143296:0@lo:400:kworker.0 00000100:00100000:3.0:1789891159.939991:0:72921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3293:x1876835061143040:12345-0@lo:400:kworker.0 Request processed in 100us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891159.940002:0:72921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:0.0:1789891159.940018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891159.940028:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1789891159.940037:0:72921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143168 00000100:00100000:3.0:1789891159.940042:0:72921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143168 00000100:00100000:1.0:1789891159.940043:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c6909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3294:x1876835061142656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940060:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061142912 00000100:00100000:0.0:1789891159.940067:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061142912 00000100:00100000:1.0:1789891159.940098:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c6909850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3294:x1876835061142656:12345-0@lo:400:kworker.0 Request processed in 58us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891159.940104:0:72921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:1.0:1789891159.940110:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3364 00000100:00100000:3.0:1789891159.940120:0:72921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3f6654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061143168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940120:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061142784 00000100:00100000:0.0:1789891159.940129:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061142784 00000100:00080000:1.0:1789891159.940169:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789891159.940169:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143296 00000100:00100000:0.0:1789891159.940179:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143296 00000100:00080000:1.0:1789891159.940183:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789891159.940191:0:72921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3f6654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061143168:12345-0@lo:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00080000:1.0:1789891159.940192:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789891159.940205:0:72921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:0.0:1789891159.940229:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1789891159.940243:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1789891159.940244:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+10:3292:x1876835061142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891159.940258:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061142784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891159.940275:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:3.0:1789891159.940291:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061143296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940305:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+10:3292:x1876835061142912:12345-0@lo:400:kworker.0 Request processed in 66us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891159.940354:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1789891159.940362:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061142784:12345-0@lo:400:kworker.0 Request processed in 104us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891159.940373:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1789891159.940391:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061143296:12345-0@lo:400:kworker.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891159.940399:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1789891159.940415:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1876835061143040:0@lo:400:kworker.0 00000100:00100000:1.0:1789891159.940460:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c684762-cb06-47df-8ceb-1f58f3195acf:3294:1876835061142656:0@lo:400:kworker.0 00000100:00100000:1.0:1789891159.940476:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061143168:0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940477:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061142784:0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940516:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061143296:0@lo:400:kworker.0 00000100:00100000:0.0:1789891159.940527:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1876835061142912:0@lo:400:kworker.0 00010000:00010000:1.0:1789891160.131492:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1789891161.076065:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.076109:0:72906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063056640 00000100:00100000:1.0:1789891161.076122:0:72906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063056640 00000100:00080000:2.0:1789891161.076174:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891161.076201:0:72906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 852 00000100:00100000:1.0:1789891161.076214:0:72906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2c483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5327920f-5495-416f-9ae4-e5a29342d64d+6:2357:x1876835063056640:12345-192.168.204.32@tcp:8:lctl.0 00010000:02000400:1.0:1789891161.076258:0:72906:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-OST0000: Client 5327920f-5495-416f-9ae4-e5a29342d64d (at 192.168.204.32@tcp) reconnecting 00010000:00080000:1.0:1789891161.079671:0:72906:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 5327920f-5495-416f-9ae4-e5a29342d64d@192.168.204.32@tcp t0 exp ffff9cd3f66ea000 cur 1849 last 1789891161 00002000:00100000:1.0:1789891161.079691:0:72906:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5327920f-5495-416f-9ae4-e5a29342d64d/ffff9cd3f66ea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211371c ocd_grant: 2097152 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789891161.079721:0:72906:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.204.32@tcp supports cksum type f7, return f7 00000100:00080000:1.0:1789891161.079748:0:72906:0:(import.c:65:import_set_state_nolock()) ffff9cd3f66ee000 : changing import state from FULL to RECOVER 00000100:00080000:1.0:1789891161.079759:0:72906:0:(import.c:65:import_set_state_nolock()) ffff9cd3f66ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789891161.079863:0:72906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2c483b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:5327920f-5495-416f-9ae4-e5a29342d64d+6:2357:x1876835063056640:12345-192.168.204.32@tcp:8:lctl.0 Request processed in 3653us (3808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891161.079872:0:72906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 852 00000100:00100000:1.0:1789891161.090689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891161.090748:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063056896 00000100:00100000:2.0:1789891161.090761:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063056896 00000100:00080000:1.0:1789891161.090825:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789891161.090863:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47436 00000100:00100000:1.0:1789891161.090875:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+16:85107:x1876835063056896:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1789891161.090904:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789891161.090926:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f2313 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789891161.091073:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc1:0x0]: returning size 7680 00010000:00010000:1.0:1789891161.091213:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2313 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.091227:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c500) 00010000:00010000:1.0:1789891161.091229:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789891161.091233:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2313 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.091251:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd307f1d600, rc 0) 00000100:00100000:1.0:1789891161.091345:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+17:85107:x1876835063056896:12345-192.168.204.32@tcp:101:rm.0 Request processed in 473us (666us total) trans 4294996363 rc 301/301 00000100:00100000:1.0:1789891161.091351:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47436 00000100:00100000:2.0:1789891161.092759:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.092816:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063057152 00000100:00100000:1.0:1789891161.092825:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063057152 00000100:00100000:1.0:1789891161.092876:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11942 00000100:00100000:1.0:1789891161.092886:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ca361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:5327920f-5495-416f-9ae4-e5a29342d64d+17:85107:x1876835063057152:12345-192.168.204.32@tcp:35:rm.0 00000100:00100000:1.0:1789891161.093101:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ca361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_007:5327920f-5495-416f-9ae4-e5a29342d64d+18:85107:x1876835063057152:12345-192.168.204.32@tcp:35:rm.0 Request processed in 217us (344us total) trans 4294996364 rc 0/0 00000100:00100000:1.0:1789891161.093107:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11942 00000100:00100000:2.0:1789891161.094221:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.094272:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063057408 00000100:00100000:1.0:1789891161.094277:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063057408 00000100:00100000:1.0:1789891161.094336:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47437 00000100:00100000:1.0:1789891161.094348:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ca360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5327920f-5495-416f-9ae4-e5a29342d64d+18:85107:x1876835063057408:12345-192.168.204.32@tcp:101:rm.0 00010000:00010000:1.0:1789891161.094366:0:14799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789891161.094389:0:14799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c800/0x5bc033517bb3ae6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f231a expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.094509:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3ae75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.094524:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3ae75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.094536:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3ae75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789891161.094552:0:14799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc1:0x0]: returning size 7680 00010000:00010000:1.0:1789891161.094652:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c800/0x5bc033517bb3ae6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f231a expref: 21 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.094671:0:14799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3ae75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f231a expref: 20 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.094678:0:14799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x0 (ffff9cd30715c700) 00010000:00010000:1.0:1789891161.094681:0:14799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789891161.094686:0:14799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd307f1ce00, rc 0) 00000100:00100000:1.0:1789891161.094738:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ca360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063057408:12345-192.168.204.32@tcp:101:rm.0 Request processed in 392us (518us total) trans 4294996365 rc 0/0 00000100:00100000:1.0:1789891161.094746:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47437 00000100:00100000:2.0:1789891161.096408:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.096461:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063057536 00000100:00100000:1.0:1789891161.096471:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063057536 00000100:00100000:1.0:1789891161.096532:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47438 00000100:00100000:1.0:1789891161.096543:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ca360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063057536:12345-192.168.204.32@tcp:41:rm.0 00000004:00000024:1.0:1789891161.096608:0:6593:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7718567936 avail 7629438976 00000100:00100000:1.0:1789891161.096683:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ca360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063057536:12345-192.168.204.32@tcp:41:rm.0 Request processed in 142us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891161.096692:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47438 00000100:00100000:2.0:1789891161.098165:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.098220:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063057792 00000100:00100000:1.0:1789891161.098227:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063057792 00000100:00100000:1.0:1789891161.098269:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47439 00000100:00100000:1.0:1789891161.098281:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ca362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063057792:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:1.0:1789891161.098381:0:72965:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789891161.098416:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3d8e7b800/0x5bc033517bb3adcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f0 expref: 20 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098437:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc2:0x0].0x0 (ffff9cd3c1321c00) 00010000:00010000:1.0:1789891161.098457:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513a00/0x5bc033517bb3ae21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2305 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098469:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x0 (ffff9cd30715c700) 00010000:00010000:1.0:1789891161.098473:0:72965:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789891161.098498:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098515:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098528:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098547:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098555:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098563:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098693:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098713:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.098721:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789891161.099432:0:72965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1132, 64 off83160 00000004:00080000:1.0:1789891161.099445:0:72965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1849448129459ns, next at 1850448125964ns, rc = 0 00010000:00010000:1.0:1789891161.099527:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099538:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099548:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099556:0:72965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099564:0:72965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099571:0:72965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099602:0:72965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789891161.099628:0:72965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099635:0:72965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099650:0:72965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099657:0:72965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1d400 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:1.0:1789891161.099662:0:72965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099671:0:72965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099682:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc2:0x0].0x0 (ffff9cd3d8e4e600) 00010000:00010000:1.0:1789891161.099685:0:72965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789891161.099690:0:72965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099696:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d400/0x5bc033517bb3ae91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1fc2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099715:0:72965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099722:0:72965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099729:0:72965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099736:0:72965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1d600 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:1.0:1789891161.099738:0:72965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099751:0:6582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789891161.099752:0:72965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099783:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099785:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x0 (ffff9cd30715c700) 00010000:00010000:1.0:1789891161.099799:0:72965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789891161.099807:0:72965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099811:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1da00 already unused, calling callback (ffffffffc13e2250) 00010000:00010000:2.0:1789891161.099821:0:6582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.099826:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d600/0x5bc033517bb3ae83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1fc1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099832:0:6582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789891161.099849:0:72965:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000070099c9a reply state 0000000002e13a1c transno 4294996366 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099856:0:6582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc2:0x0].0x0 (ffff9cd3d8e4e600) 00010000:00010000:2.0:1789891161.099865:0:6582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789891161.099869:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891161.099880:0:72965:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789891161.099881:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3ae98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fc2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.099908:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891161.099911:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891161.099913:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891161.099984:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ca362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063057792:12345-192.168.204.32@tcp:36:rm.0 Request processed in 1701us (1823us total) trans 4294996366 rc 0/0 00000100:00100000:1.0:1789891161.099995:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47439 00010000:00010000:1.0:1789891161.100824:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100833:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100838:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100841:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1d000 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:1.0:1789891161.100843:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100857:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100866:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x1e5e4b0f (ffff9cd3d8e4e100) 00010000:00010000:1.0:1789891161.100868:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789891161.100870:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.100875:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1d000/0x5bc033517bb3ae8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fc1:0x0].0x1e5e4b0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891161.132796:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891161.132862:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058048 00000100:00100000:1.0:1789891161.132875:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058048 00000100:00100000:1.0:1789891161.132947:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 11943 00000100:00100000:1.0:1789891161.132961:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5327920f-5495-416f-9ae4-e5a29342d64d+19:85107:x1876835063058048:12345-192.168.204.32@tcp:35:rm.0 00000100:00100000:1.0:1789891161.133288:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063058048:12345-192.168.204.32@tcp:35:rm.0 Request processed in 331us (501us total) trans 4294996367 rc 0/0 00000100:00100000:1.0:1789891161.133297:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 11943 00000100:00100000:1.0:1789891161.134181:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891161.134216:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058304 00000100:00100000:3.0:1789891161.134222:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058304 00000100:00100000:3.0:1789891161.134267:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47440 00000100:00100000:3.0:1789891161.134276:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+20:85107:x1876835063058304:12345-192.168.204.32@tcp:36:rm.0 00010000:00010000:3.0:1789891161.134339:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789891161.134375:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3ae75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f231a expref: 20 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134415:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3ad95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22e9 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134429:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x0 (ffff9cd30715c700) 00010000:00010000:3.0:1789891161.134451:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e2800/0x5bc033517bb3ad56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22db expref: 18 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134464:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c500) 00010000:00010000:3.0:1789891161.134473:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789891161.134502:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134518:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134530:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134544:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134552:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134559:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134936:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134950:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.134957:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789891161.135563:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc1:0x0]: returning size 7680 00010000:00010000:3.0:1789891161.135577:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135583:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135588:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135592:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512e00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891161.135595:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135600:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135607:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc1:0x0].0x0 (ffff9cd30715cb00) 00010000:00010000:3.0:1789891161.135609:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789891161.135611:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135615:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aead lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1fc1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135636:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135640:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135644:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135647:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512c00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891161.135648:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135652:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135655:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30715c800) 00010000:00010000:3.0:1789891161.135657:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891161.135658:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.135661:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3ae9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789891161.135667:0:5771:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000012d97fd6 reply state 00000000a6d0b039 transno 4294996368 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891161.135673:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789891161.135736:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+19:85107:x1876835063058304:12345-192.168.204.32@tcp:36:rm.0 Request processed in 1461us (1558us total) trans 4294996368 rc 0/0 00000100:00100000:3.0:1789891161.135742:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47440 00010000:00010000:2.0:1789891161.136467:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136488:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136495:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136501:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6513400 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:2.0:1789891161.136504:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136511:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136522:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7dafcf20 (ffff9cd30715c600) 00010000:00010000:2.0:1789891161.136525:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789891161.136528:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.136533:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513400/0x5bc033517bb3aea6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7dafcf20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891161.139199:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891161.139251:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058432 00000100:00100000:2.0:1789891161.139262:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058432 00000100:00100000:2.0:1789891161.139371:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47441 00000100:00100000:2.0:1789891161.139384:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5327920f-5495-416f-9ae4-e5a29342d64d+18:84148:x1876835063058432:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:2.0:1789891161.139412:0:14799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789891161.139433:0:14799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3800/0x5bc033517bb3aeb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f2321 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139512:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139524:0:14799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139531:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789891161.139584:0:14799:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789891161.139586:0:14799:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789891161.139603:0:14799:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14799 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139621:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3800/0x5bc033517bb3aeb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2321 expref: 20 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139632:0:14799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2321 expref: 19 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.139639:0:14799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:2.0:1789891161.139640:0:14799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789891161.139642:0:14799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd3083e3000, rc 0) 00000100:00100000:2.0:1789891161.139693:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5327920f-5495-416f-9ae4-e5a29342d64d+19:84148:x1876835063058432:12345-192.168.204.32@tcp:101:bash.0 Request processed in 315us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891161.139697:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47441 00000100:00100000:1.0:1789891161.140573:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891161.140620:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058560 00000100:00100000:3.0:1789891161.140627:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058560 00000100:00100000:3.0:1789891161.140663:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47442 00000100:00100000:3.0:1789891161.140671:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+19:84148:x1876835063058560:12345-192.168.204.32@tcp:101:bash.0 00010000:00010000:3.0:1789891161.140683:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789891161.140696:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3aec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f2328 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140753:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140762:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140784:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140828:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140834:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140841:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140906:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140915:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140933:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140938:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512c00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891161.140941:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140947:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140955:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:3.0:1789891161.140959:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891161.140963:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140969:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140979:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140985:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140992:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.140998:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512e00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891161.141001:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141014:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141020:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd340e2c6 (ffff9cd30715c800) 00010000:00010000:3.0:1789891161.141021:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891161.141023:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141027:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aed0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd340e2c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141050:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3aec2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2328 expref: 20 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141060:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:3.0:1789891161.141062:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891161.141065:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3aec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2328 expref: 20 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.141074:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd3c6512800, rc 0) 00000100:00100000:3.0:1789891161.141120:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+19:84148:x1876835063058560:12345-192.168.204.32@tcp:101:bash.0 Request processed in 451us (550us total) trans 0 rc 301/301 00000100:00100000:3.0:1789891161.141129:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47442 00010000:00010000:3.0:1789891161.155431:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789891161.918016:0:83312:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1850266699353ns, next at 1803970745287ns, rc = 0 00000004:00080000:1.0:1789891161.918132:0:83312:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1850266815617ns, next at 1850448125964ns, rc = 0 00000001:00080000:3.0:1789891161.933633:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996356 is committed 00000004:00080000:3.0:1789891161.933669:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 303 committed 00000001:00080000:3.0:1789891161.933689:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996367 is committed 00000004:00080000:3.0:1789891161.933697:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 266 committed 00000001:00080000:3.0:1789891161.933782:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996368 is committed 00000100:00100000:3.0:1789891161.933886:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061143424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789891161.933957:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891161.933991:0:40716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143424 00000100:00100000:2.0:1789891161.933999:0:40716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143424 00000100:00080000:0.0:1789891161.934078:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789891161.934084:0:40716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7819 00000100:00100000:2.0:1789891161.934097:0:40716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061143424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789891161.934127:0:40716:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1023 count 1 00010000:00010000:2.0:1789891161.934152:0:40716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.934173:0:40716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 103 pid: 72919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.934183:0:40716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3ff:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1789891161.934188:0:40716:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789891161.934193:0:40716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.934221:0:40716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 103 pid: 72919 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891161.934235:0:40716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 103 pid: 72919 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789891161.934248:0:40716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:40716:1876835061143552:192.168.204.32@tcp:104: 00000100:00100000:2.0:1789891161.934339:0:40716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cd2cebc6900 going to sleep for 11 seconds 00000004:00080000:2.0:1789891161.935336:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 267 committed 00000100:00100000:2.0:1789891161.935907:0:40716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:40716:1876835061143552:192.168.204.32@tcp:104: 00010000:00010000:2.0:1789891161.935926:0:40716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891161.936046:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891161.936134:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058688 00000100:00100000:3.0:1789891161.936140:0:8260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058688 00010000:00010000:3.0:1789891161.936174:0:8260:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 104 pid: 72919 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789891161.936196:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789891161.936205:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 12078 00000100:00100000:3.0:1789891161.936213:0:8260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5327920f-5495-416f-9ae4-e5a29342d64d+104:2361:x1876835063058688:12345-192.168.204.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789891161.936222:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789891161.936226:0:8260:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 104 pid: 72919 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.936235:0:8260:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 104 pid: 72919 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.936254:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddff7cc7/0x5bc033517bb3ade2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f22f7 expref: 104 pid: 72919 timeout: 1950 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.936269:0:8260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789891161.936273:0:8260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3ff:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789891161.936279:0:8260:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.936289:0:8260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891161.936361:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789891161.936366:0:40716:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.936401:0:40716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891161.936403:0:8260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5327920f-5495-416f-9ae4-e5a29342d64d+103:2361:x1876835063058688:12345-192.168.204.32@tcp:103:ldlm_bl.0 Request processed in 190us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891161.936433:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 12078 00010000:00010000:1.0:1789891161.936438:0:40716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.936448:0:40716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891161.936473:0:40716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789891161.936514:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789891161.936524:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891161.936537:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3083e2800 already unused, calling callback (ffffffffc13e2250) 00010000:00010000:0.0:1789891161.936544:0:5759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891161.936555:0:5759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891161.936572:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891161.936581:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e0fc3d3/0x5bc033517bb3aed7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 40716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891161.936601:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789891161.936603:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789891161.936605:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891161.964823:0:40716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3292:x1876835061143424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30718us (30854us total) trans 4294969952 rc 0/0 00000100:00100000:1.0:1789891161.964840:0:40716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7819 00000004:00080000:3.0:1789891161.964987:0:3292:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cd3ef43e300/2, rc 0, transno 4294969952 00000100:00100000:3.0:1789891161.965005:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061143424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789891161.988551:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1876835061143680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789891161.988632:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891161.988721:0:10272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143680 00000100:00100000:1.0:1789891161.988729:0:10272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143680 00000100:00100000:1.0:1789891161.988823:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1789891161.988836:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1876835061143680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789891161.988863:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789891161.988921:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1876835061143680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891161.988928:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:1.0:1789891161.988954:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891161.989011:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1876835061143680:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789891161.997378:0:80393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5327920f-5495-416f-9ae4-e5a29342d64d 00010000:00010000:1.0:1789891162.179449:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789891162.512059:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969952 is committed 00000001:00080000:2.0:1789891162.512084:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969950 is committed 00000001:00080000:2.0:1789891162.512247:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294969951 is committed 00000100:00100000:1.0:1789891162.517249:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891162.517297:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891162.517306:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058816 00000100:00100000:0.0:1789891162.517334:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058816 00000100:00100000:3.0:1789891162.517350:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063058944 00000100:00100000:3.0:1789891162.517357:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063058944 00000100:00100000:1.0:1789891162.517373:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891162.517396:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3365 00000100:00100000:0.0:1789891162.517411:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c690ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2360:x1876835063058816:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789891162.517413:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1264 00000100:00100000:1.0:1789891162.517415:0:72901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059072 00000100:00100000:1.0:1789891162.517422:0:72901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059072 00000100:00100000:3.0:1789891162.517434:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:2361:x1876835063058944:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789891162.517463:0:72901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 853 00000100:00100000:1.0:1789891162.517472:0:72901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063059072:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891162.517504:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c690ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2360:x1876835063058816:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891162.517510:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:2361:x1876835063058944:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891162.517514:0:72901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063059072:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891162.517515:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3365 00000100:00100000:3.0:1789891162.517534:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1264 00000100:00100000:1.0:1789891162.517535:0:72901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 853 00010000:00010000:2.0:1789891163.203573:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891163.523531:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061143808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789891163.523620:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891163.523660:0:6570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143808 00000100:00100000:2.0:1789891163.523670:0:6570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143808 00000100:00080000:0.0:1789891163.523744:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789891163.523767:0:6570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1789891163.523783:0:6570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061143808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789891163.523830:0:6570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125239296 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789891163.523889:0:6570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061143808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891163.523898:0:6570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1789891163.523911:0:3294:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969952 gen 2 00000004:00080000:1.0:1789891163.523917:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cd3ef43e300, transno 4294969952 00000100:00100000:1.0:1789891163.523936:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061143808:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789891164.227582:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891165.059519:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061143936:0@lo:400:kworker.0 00000100:00100000:3.0:1789891165.059530:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061144064:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.059562:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061144192:0@lo:400:kworker.0 00000100:00100000:3.0:1789891165.059619:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891165.059620:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891165.059633:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144320:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.059663:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061143936 00000100:00100000:2.0:1789891165.059673:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061143936 00000100:00100000:0.0:1789891165.059681:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891165.059705:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061144576:0@lo:400:kworker.0 00000100:00100000:1.0:1789891165.059707:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d826b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061144448:0@lo:400:kworker.0 00000100:00100000:1.0:1789891165.059749:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891165.059752:0:6567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144320 00000100:00100000:3.0:1789891165.059757:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891165.059758:0:6567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144320 00000100:00100000:2.0:1789891165.059765:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3366 00000100:00100000:2.0:1789891165.059779:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c690a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061143936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891165.059803:0:40714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144448 00000100:00100000:1.0:1789891165.059808:0:40714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144448 00000100:00100000:3.0:1789891165.059809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891165.059820:0:6567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1789891165.059831:0:6567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891165.059856:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144064 00000100:00100000:1.0:1789891165.059856:0:40714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1789891165.059863:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144064 00000100:00100000:2.0:1789891165.059869:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c690a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061143936:12345-0@lo:400:kworker.0 Request processed in 91us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891165.059870:0:40714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061144448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.059886:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3366 00000100:00100000:0.0:1789891165.059891:0:6567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144320:12345-0@lo:400:kworker.0 Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891165.059901:0:6567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1789891165.059907:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144576 00000100:00100000:3.0:1789891165.059912:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144576 00000100:00100000:1.0:1789891165.059916:0:40714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061144448:12345-0@lo:400:kworker.0 Request processed in 50us (168us total) trans 0 rc 0/0 00000100:00080000:0.0:1789891165.059929:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789891165.059930:0:40714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00080000:0.0:1789891165.059939:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789891165.059944:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144192 00000100:00080000:0.0:1789891165.059944:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789891165.059948:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789891165.059951:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144192 00000100:00100000:3.0:1789891165.059957:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061144064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891165.059963:0:72896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1789891165.059974:0:72896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061144576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.059995:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1789891165.059995:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144320:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.060009:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061144192:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789891165.060027:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789891165.060029:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061144064:12345-0@lo:400:kworker.0 Request processed in 71us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891165.060030:0:72896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061144576:12345-0@lo:400:kworker.0 Request processed in 58us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891165.060041:0:72896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1789891165.060048:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1789891165.060074:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061144192:12345-0@lo:400:kworker.0 Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891165.060074:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d826b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061144448:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.060088:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1789891165.060093:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061143936:0@lo:400:kworker.0 00000100:00100000:3.0:1789891165.060104:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061144192:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.060136:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061144576:0@lo:400:kworker.0 00000100:00100000:2.0:1789891165.060150:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061144064:0@lo:400:kworker.0 00010000:00010000:0.0:1789891165.251473:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789891166.275597:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891167.107553:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789891167.107589:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789891167.107691:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891167.107796:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144704 00000100:00100000:2.0:1789891167.107811:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144704 00000100:00080000:1.0:1789891167.107884:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891167.107919:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1789891167.107930:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789891167.107972:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789891167.108032:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891167.108042:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:1.0:1789891167.108109:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789891167.299576:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789891167.637883:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891167.637947:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891167.637980:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059200 00000100:00100000:3.0:1789891167.637994:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891167.637996:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059200 00000100:00100000:1.0:1789891167.638027:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059328 00000100:00100000:1.0:1789891167.638036:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059328 00000100:00100000:3.0:1789891167.638043:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891167.638069:0:72919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059584 00000100:00100000:0.0:1789891167.638077:0:72919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059584 00000100:00100000:3.0:1789891167.638078:0:40715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059456 00000100:00100000:3.0:1789891167.638083:0:40715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059456 00000100:00100000:2.0:1789891167.638105:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3367 00000100:00100000:2.0:1789891167.638130:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c6908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063059200:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789891167.638137:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1268 00000100:00100000:3.0:1789891167.638145:0:40715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 856 00000100:00100000:0.0:1789891167.638154:0:72919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 857 00000100:00100000:1.0:1789891167.638160:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063059328:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789891167.638161:0:40715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063059456:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891167.638169:0:72919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063059584:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891167.638244:0:72919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063059584:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 71us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891167.638256:0:40715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063059456:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891167.638259:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063059328:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 83us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891167.638260:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c6908050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063059200:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 119us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891167.638281:0:72919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 857 00000100:00100000:1.0:1789891167.638288:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1268 00000100:00100000:3.0:1789891167.638292:0:40715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 856 00000100:00100000:2.0:1789891167.638301:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3367 00000100:00080000:1.0:1789891167.638381:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789891167.638388:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789891167.638391:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789891168.323875:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891168.643564:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789891168.643670:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891168.643730:0:6570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144832 00000100:00100000:2.0:1789891168.643739:0:6570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144832 00000100:00080000:1.0:1789891168.643779:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789891168.643817:0:6570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1789891168.643826:0:6570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789891168.643858:0:6570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125239296 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789891168.643904:0:6570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061144832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891168.643910:0:6570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:1.0:1789891168.643950:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd2c5ac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061144832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789891169.347529:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891170.179578:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061145088:0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.179578:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061144960:0@lo:400:kworker.0 00000100:00100000:2.0:1789891170.179659:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891170.179659:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891170.179723:0:29195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061144960 00000100:00100000:3.0:1789891170.179733:0:29195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061144960 00000100:00100000:1.0:1789891170.179734:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061145216:0@lo:400:kworker.0 00000100:00100000:2.0:1789891170.179737:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061145600:0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.179737:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061145472:0@lo:400:kworker.0 00000100:00100000:3.0:1789891170.179776:0:29195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3368 00000100:00100000:3.0:1789891170.179787:0:29195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c6909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061144960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.179794:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891170.179804:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891170.179849:0:40373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145472 00000100:00100000:1.0:1789891170.179858:0:40373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145472 00000100:00100000:3.0:1789891170.179873:0:29195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c6909450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061144960:12345-0@lo:400:kworker.0 Request processed in 88us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891170.179884:0:29195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3368 00000100:00100000:0.0:1789891170.179884:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145344:0@lo:400:kworker.0 00000100:00100000:2.0:1789891170.179889:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145088 00000100:00100000:2.0:1789891170.179894:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145088 00000100:00100000:0.0:1789891170.179932:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891170.179948:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145600 00000100:00100000:3.0:1789891170.179954:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145600 00000100:00100000:2.0:1789891170.179954:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1789891170.179958:0:40373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145344 00000100:00100000:2.0:1789891170.179964:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2c5ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061145088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891170.179965:0:40373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145344 00000100:00100000:0.0:1789891170.180006:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061144960:0@lo:400:kworker.0 00000100:00100000:3.0:1789891170.180019:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1789891170.180024:0:40373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1789891170.180033:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2c5ac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061145088:12345-0@lo:400:kworker.0 Request processed in 70us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891170.180043:0:40373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061145472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891170.180046:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061145600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789891170.180056:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789891170.180064:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789891170.180066:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00080000:0.0:1789891170.180068:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789891170.180080:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891170.180112:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061145088:0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.180146:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145216 00000100:00100000:3.0:1789891170.180147:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061145600:12345-0@lo:400:kworker.0 Request processed in 108us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891170.180148:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061145600:0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.180150:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145216 00000100:00100000:3.0:1789891170.180160:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1789891170.180160:0:40373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061145472:12345-0@lo:400:kworker.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891170.180181:0:40373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:3.0:1789891170.180188:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:3.0:1789891170.180199:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061145216:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789891170.180201:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789891170.180219:0:40373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1789891170.180236:0:40373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c2daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891170.180244:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061145216:12345-0@lo:400:kworker.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891170.180249:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1789891170.180266:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061145216:0@lo:400:kworker.0 00000100:00100000:0.0:1789891170.180268:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061145472:0@lo:400:kworker.0 00000100:00100000:1.0:1789891170.180311:0:40373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c2daf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145344:12345-0@lo:400:kworker.0 Request processed in 76us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891170.180343:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145344:0@lo:400:kworker.0 00000100:00100000:1.0:1789891170.180362:0:40373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00010000:00010000:1.0:1789891170.371486:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891171.395518:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891172.227585:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789891172.227621:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789891172.227692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891172.227756:0:10272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145728 00000100:00100000:2.0:1789891172.227769:0:10272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145728 00000100:00080000:3.0:1789891172.227858:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789891172.227866:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:2.0:1789891172.227883:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789891172.227938:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789891172.228044:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891172.228055:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00100000:3.0:1789891172.228105:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145728:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789891172.419579:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891172.757174:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891172.757244:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891172.757246:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059712 00000100:00100000:1.0:1789891172.757262:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059712 00000100:00100000:2.0:1789891172.757295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891172.757351:0:72896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059840 00000100:00100000:0.0:1789891172.757356:0:72896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059840 00000100:00100000:1.0:1789891172.757377:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3369 00000100:00100000:3.0:1789891172.757384:0:72921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060096 00000100:00100000:3.0:1789891172.757391:0:72921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060096 00000100:00100000:1.0:1789891172.757392:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c6908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063059712:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789891172.757401:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891172.757406:0:72896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1272 00000100:00100000:0.0:1789891172.757420:0:72896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063059840:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789891172.757437:0:72921:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063059968 00000100:00100000:3.0:1789891172.757441:0:72921:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063059968 00000100:00100000:2.0:1789891172.757461:0:40374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 860 00000100:00100000:2.0:1789891172.757480:0:40374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063060096:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:3.0:1789891172.757489:0:72921:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 861 00000100:00100000:1.0:1789891172.757503:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c6908450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063059712:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891172.757503:0:72896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063059840:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891172.757520:0:72896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1272 00000100:00100000:1.0:1789891172.757521:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3369 00000100:00100000:2.0:1789891172.757533:0:40374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063060096:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 55us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891172.757553:0:40374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 860 00000100:00100000:3.0:1789891172.757587:0:72921:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063059968:12345-192.168.204.32@tcp:400:kworker.0 00000100:00080000:0.0:1789891172.757602:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789891172.757609:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789891172.757613:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789891172.757627:0:72921:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063059968:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 128us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891172.757635:0:72921:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 861 00010000:00010000:0.0:1789891173.443561:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789891173.763590:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789891173.763658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891173.763737:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145856 00000100:00100000:1.0:1789891173.763758:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145856 00000100:00080000:0.0:1789891173.763827:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789891173.763856:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1789891173.763870:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789891173.763931:0:6571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125239296 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789891173.764027:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061145856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891173.764036:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:3.0:1789891173.764089:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061145856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789891174.467913:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891175.300452:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061146112:0@lo:400:kworker.0 00000100:00100000:0.0:1789891175.300452:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061145984:0@lo:400:kworker.0 00000100:00100000:3.0:1789891175.300473:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061146240:0@lo:400:kworker.0 00000100:00100000:1.0:1789891175.300532:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061146368:0@lo:400:kworker.0 00000100:00100000:2.0:1789891175.300554:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891175.300554:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891175.300587:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146112 00000100:00100000:1.0:1789891175.300591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891175.300597:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146112 00000100:00100000:2.0:1789891175.300626:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061146624:0@lo:400:kworker.0 00000100:00100000:0.0:1789891175.300627:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061146496:0@lo:400:kworker.0 00000100:00100000:1.0:1789891175.300642:0:72906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146368 00000100:00100000:1.0:1789891175.300648:0:72906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146368 00000100:00100000:3.0:1789891175.300665:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1789891175.300673:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891175.300677:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061146112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891175.300681:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891175.300702:0:72906:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146496 00000100:00100000:1.0:1789891175.300706:0:72906:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146496 00000100:00080000:0.0:1789891175.300734:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789891175.300740:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891175.300743:0:72906:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789891175.300745:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3292:x1876835061146112:12345-0@lo:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891175.300756:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146624 00000100:00100000:3.0:1789891175.300757:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1789891175.300758:0:72906:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061146368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891175.300762:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146624 00000100:00100000:2.0:1789891175.300770:0:72902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1789891175.300779:0:72902:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061146496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891175.300787:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061145984 00000100:00100000:3.0:1789891175.300791:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061145984 00000100:00100000:0.0:1789891175.300802:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1789891175.300812:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891175.300823:0:72906:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061146368:12345-0@lo:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891175.300828:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3370 00000100:00100000:2.0:1789891175.300834:0:72902:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061146496:12345-0@lo:400:kworker.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891175.300837:0:72906:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1789891175.300844:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c690b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061145984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891175.300857:0:72902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:0.0:1789891175.300869:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3292:x1876835061146624:12345-0@lo:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891175.300876:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:3.0:1789891175.300892:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c690b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3291:x1876835061145984:12345-0@lo:400:kworker.0 Request processed in 53us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891175.300894:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061146368:0@lo:400:kworker.0 00000100:00080000:0.0:1789891175.300900:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789891175.300901:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3370 00000100:00100000:0.0:1789891175.300924:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061146496:0@lo:400:kworker.0 00000100:00100000:0.0:1789891175.300934:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c684762-cb06-47df-8ceb-1f58f3195acf:3291:1876835061145984:0@lo:400:kworker.0 00000100:00100000:3.0:1789891175.300953:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891175.300963:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef439180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1876835061146624:0@lo:400:kworker.0 00000100:00100000:1.0:1789891175.300985:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1876835061146112:0@lo:400:kworker.0 00000100:00100000:2.0:1789891175.300996:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146240 00000100:00100000:2.0:1789891175.301001:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146240 00000100:00100000:2.0:1789891175.301032:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00080000:0.0:1789891175.301034:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789891175.301038:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061146240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891175.301067:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061146240:12345-0@lo:400:kworker.0 Request processed in 31us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891175.301071:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1789891175.301101:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061146240:0@lo:400:kworker.0 00010000:00010000:2.0:1789891175.491532:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789891175.811995:0:83685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1864160677939ns, next at 1803970745287ns, rc = 0 00000004:00080000:3.0:1789891175.812073:0:83685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1864160757317ns, next at 1850448125964ns, rc = 0 00000004:00080000:2.0:1789891175.812912:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 304 committed 00000004:00080000:2.0:1789891175.813728:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 268 committed 00000100:00100000:1.0:1789891176.234167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891176.234210:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060224 00000100:00100000:0.0:1789891176.234221:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060224 00000100:00080000:1.0:1789891176.234262:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789891176.234288:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47443 00000100:00100000:0.0:1789891176.234299:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:85581:x1876835063060224:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:1.0:1789891176.242485:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef439180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061146752:0@lo:106: 00000100:00100000:1.0:1789891176.242567:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891176.242601:0:5754:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789891176.242618:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cd3efb4fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789891176.242620:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146752 00000100:00100000:0.0:1789891176.242628:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146752 00000100:00100000:0.0:1789891176.242676:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1789891176.242684:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ebc18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:6593:x1876835061146752:12345-0@lo:106: 00010000:00010000:0.0:1789891176.242696:0:5754:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd2c1e0cc00/0x5bc033517ba34318 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba34326 expref: -99 pid: 46102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891176.242707:0:5754:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd2c1e0cc00/0x5bc033517ba34318 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba34326 expref: -99 pid: 46102 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789891176.242774:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ebc18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:6593:x1876835061146752:12345-0@lo:106: Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891176.242782:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1789891176.242812:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef439180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061146752:0@lo:106: 00000100:00100000:0.0:1789891176.242974:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789891176.242985:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1876835061146880:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789891176.243022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891176.243585:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061146880 00000100:00100000:1.0:1789891176.243590:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061146880 00000100:00100000:1.0:1789891176.243627:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11944 00000100:00100000:1.0:1789891176.243635:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3294:x1876835061146880:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789891176.244927:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-MDT0000_UUID+13:3294:x1876835061146880:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1293us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.244934:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11944 00000100:00100000:1.0:1789891176.244977:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1876835061146880:0@lo:601:lquota_wb_lustr.0 00010000:00010000:1.0:1789891176.245184:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245195:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245203:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245211:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245229:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789891176.245870:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789891176.245878:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245886:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3d8e7aa00 already unused, calling callback (ffffffffc1b79e90) 00040000:00010000:1.0:1789891176.245890:0:5758:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245903:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00040000:00010000:1.0:1789891176.245912:0:5758:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245943:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.245955:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789891176.245983:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1789891176.245988:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1876835061147008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789891176.245994:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7aa00/0x5bc033517bb3adb1 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adb8 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:1.0:1789891176.246017:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789891176.246021:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789891176.246025:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891176.246030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891176.246240:0:36665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147008 00000100:00100000:2.0:1789891176.246246:0:36665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147008 00000100:00100000:2.0:1789891176.246280:0:36665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:2.0:1789891176.246295:0:36665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-lwp-MDT0000_UUID+13:3294:x1876835061147008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789891176.246305:0:36665:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789891176.246341:0:36665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513000/0x5bc033517bb3adb8 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x10000:0xea60].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bc033517bb3adb1 expref: 13 pid: 5773 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891176.246367:0:36665:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789891176.246407:0:36665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000-lwp-MDT0000_UUID+12:3294:x1876835061147008:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891176.246414:0:36665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:2.0:1789891176.246451:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1876835061147008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789891176.252447:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147136:0@lo:106: 00000100:00100000:2.0:1789891176.252520:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891176.252543:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147136 00000100:00100000:0.0:1789891176.252549:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147136 00000100:00100000:2.0:1789891176.252567:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147264:0@lo:106: 00000100:00100000:2.0:1789891176.252590:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891176.252593:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1789891176.252603:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6593:x1876835061147136:12345-0@lo:106: 00000100:00100000:3.0:1789891176.252615:0:11158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147264 00010000:00010000:0.0:1789891176.252615:0:5753:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff9cd3d8e7b200/0x5bc033517bb3abf1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517bb3abff expref: -99 pid: 80385 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891176.252622:0:11158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147264 00000100:00100000:2.0:1789891176.252623:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147392:0@lo:106: 00010000:00010000:0.0:1789891176.252629:0:5753:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff9cd3d8e7b200/0x5bc033517bb3abf1 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517bb3abff expref: -99 pid: 80385 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789891176.252647:0:6593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.252663:0:11158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147392 00000100:00100000:3.0:1789891176.252668:0:11158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147392 00000100:00100000:2.0:1789891176.252670:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cd2c5bea540 going to sleep for 11 seconds 00000100:00100000:1.0:1789891176.252675:0:18551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:1.0:1789891176.252689:0:18551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6593:x1876835061147264:12345-0@lo:106: 00000100:00100000:3.0:1789891176.252695:0:11158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00010000:00010000:1.0:1789891176.252700:0:18551:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3ef38a200/0x5bc033517ba2f841 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f84f expref: -99 pid: 14197 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789891176.252702:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0000+8:6593:x1876835061147136:12345-0@lo:106: Request processed in 100us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.252708:0:11158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:6593:x1876835061147392:12345-0@lo:106: 00000100:00100000:2.0:1789891176.252709:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147136:0@lo:106: 00000100:00100000:0.0:1789891176.252715:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00010000:00010000:3.0:1789891176.252723:0:11158:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d4179e00/0x5bc033517ba2f88e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f89c expref: -99 pid: 14206 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891176.252725:0:18551:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3ef38a200/0x5bc033517ba2f841 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f84f expref: -99 pid: 14197 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891176.252743:0:11158:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d4179e00/0x5bc033517ba2f88e lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f89c expref: -99 pid: 14206 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891176.252798:0:18551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:6593:x1876835061147264:12345-0@lo:106: Request processed in 112us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.252808:0:18551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:3.0:1789891176.252809:0:11158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0001+8:6593:x1876835061147392:12345-0@lo:106: Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.252820:0:11158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:3.0:1789891176.253123:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3ef43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1876835061147520:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789891176.253165:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.253194:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789891176.253204:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1876835061147648:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789891176.253239:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.253274:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147520 00000100:00100000:3.0:1789891176.253277:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147520 00000100:00100000:3.0:1789891176.253308:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147648 00000100:00100000:3.0:1789891176.253311:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147648 00000100:00100000:3.0:1789891176.253363:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11945 00000100:00100000:3.0:1789891176.253372:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3e6362050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:lustre-MDT0000-lwp-OST0001_UUID+10:3291:x1876835061147520:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789891176.253727:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11946 00000100:00100000:2.0:1789891176.253736:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_006:lustre-MDT0000-lwp-OST0000_UUID+8:3291:x1876835061147648:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789891176.253792:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_006:lustre-MDT0000-lwp-OST0000_UUID+8:3291:x1876835061147648:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 58us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891176.253801:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11946 00000100:00100000:2.0:1789891176.253857:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1876835061147648:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789891176.253950:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147264:0@lo:106: 00000100:00100000:1.0:1789891176.253966:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6593:1876835061147392:0@lo:106: 00000100:00100000:1.0:1789891176.254035:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:85581:x1876835063060224:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 19738us (19873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.254043:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47443 00000100:00100000:3.0:1789891176.254616:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3e6362050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:lustre-MDT0000-lwp-OST0001_UUID+10:3291:x1876835061147520:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1245us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.254621:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11945 00000100:00100000:2.0:1789891176.254655:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3ef43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1876835061147520:0@lo:601:lquota_wb_lustr.0 00010000:00010000:0.0:1789891176.254757:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.254768:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.254776:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.254784:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.254801:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789891176.254818:0:5759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789891176.254824:0:5759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.254831:0:5759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3d8e7a200 already unused, calling callback (ffffffffc1b79e90) 00040000:00010000:2.0:1789891176.254835:0:5759:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.254843:0:5759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00040000:00010000:2.0:1789891176.254850:0:5759:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.254875:0:5759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.254881:0:5759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789891176.254904:0:5759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.254912:0:5759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7a200/0x5bc033517bb3ade9 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adf0 expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:3.0:1789891176.254925:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061147776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789891176.254927:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891176.254930:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891176.254933:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789891176.254960:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891176.254987:0:72903:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147776 00000100:00100000:2.0:1789891176.254993:0:72903:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147776 00000100:00100000:2.0:1789891176.255024:0:72903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:2.0:1789891176.255038:0:72903:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-lwp-OST0001_UUID+10:3293:x1876835061147776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789891176.255048:0:72903:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789891176.255061:0:72903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e2400/0x5bc033517bb3adf0 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x20000:0xea60].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bc033517bb3ade9 expref: 10 pid: 11763 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891176.255084:0:72903:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789891176.255116:0:72903:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-lwp-OST0001_UUID+9:3293:x1876835061147776:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891176.255124:0:72903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4225 00000100:00100000:3.0:1789891176.255128:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1876835061147776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789891176.268052:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891176.268099:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060352 00000100:00100000:2.0:1789891176.268110:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060352 00000100:00100000:2.0:1789891176.268167:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47444 00000100:00100000:2.0:1789891176.268180:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:85584:x1876835063060352:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:0.0:1789891176.280083:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061147904:0@lo:106: 00000100:00100000:0.0:1789891176.280146:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891176.280175:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061147904 00000100:00100000:1.0:1789891176.280183:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061147904 00000100:00100000:0.0:1789891176.280191:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cd3d85179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789891176.280235:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789891176.280246:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:5769:x1876835061147904:12345-0@lo:106: 00010000:00010000:1.0:1789891176.280259:0:5753:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd2c4cd2600/0x5bc033517ba3431f lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba34334 expref: -99 pid: 46103 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891176.280270:0:5753:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd2c4cd2600/0x5bc033517ba3431f lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1010000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba34334 expref: -99 pid: 46103 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891176.280373:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0000+7:5769:x1876835061147904:12345-0@lo:106: Request processed in 128us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.280382:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1789891176.280523:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789891176.280534:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d826ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061148032:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789891176.280573:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.280597:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148032 00000100:00100000:3.0:1789891176.280607:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148032 00000100:00100000:3.0:1789891176.280650:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11947 00000100:00100000:3.0:1789891176.280660:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+12:3293:x1876835061148032:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789891176.280990:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061147904:0@lo:106: 00000100:00100000:3.0:1789891176.281826:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-MDT0000_UUID+12:3293:x1876835061148032:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1167us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.281835:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11947 00000100:00100000:0.0:1789891176.281906:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d826ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061148032:0@lo:601:lquota_wb_lustr.0 00010000:00010000:2.0:1789891176.282030:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282039:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282045:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282053:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282073:0:5800:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789891176.282668:0:6583:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789891176.282675:0:6583:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282689:0:6583:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3d8e7ac00 already unused, calling callback (ffffffffc1b79e90) 00040000:00010000:2.0:1789891176.282693:0:6583:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282704:0:6583:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00040000:00010000:2.0:1789891176.282712:0:6583:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282743:0:6583:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 2/0,0 mode: --/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282749:0:6583:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789891176.282776:0:6583:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 1/0,0 mode: --/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.282784:0:6583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3d8e7ac00/0x5bc033517bb3adbf lrc: 0/0,0 mode: --/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adc6 expref: -99 pid: 14799 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00000100:00100000:0.0:1789891176.282789:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1876835061148160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789891176.282805:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891176.282809:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891176.282812:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891176.282825:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891176.282866:0:14086:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148160 00000100:00100000:0.0:1789891176.282871:0:14086:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148160 00000100:00100000:0.0:1789891176.282915:0:14086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4226 00000100:00100000:0.0:1789891176.282938:0:14086:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-lwp-MDT0000_UUID+12:3291:x1876835061148160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789891176.282949:0:14086:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789891176.282961:0:14086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513200/0x5bc033517bb3adc6 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x1010000:0xea60].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bc033517bb3adbf expref: 12 pid: 14200 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891176.282987:0:14086:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789891176.283030:0:14086:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3291:x1876835061148160:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891176.283037:0:14086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4226 00000100:00100000:2.0:1789891176.283044:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1876835061148160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789891176.289277:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148288:0@lo:106: 00000100:00100000:0.0:1789891176.289345:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.289373:0:11158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148288 00000100:00100000:3.0:1789891176.289380:0:11158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148288 00000100:00100000:0.0:1789891176.289390:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d826b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148416:0@lo:106: 00000100:00100000:0.0:1789891176.289419:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.289420:0:11158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:3.0:1789891176.289431:0:11158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:5769:x1876835061148288:12345-0@lo:106: 00010000:00010000:3.0:1789891176.289441:0:11158:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff9cd3083e3a00/0x5bc033517bb3abea lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517bb3ac06 expref: -99 pid: 80386 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891176.289441:0:5754:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789891176.289453:0:11158:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff9cd3083e3a00/0x5bc033517bb3abea lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517bb3ac06 expref: -99 pid: 80386 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789891176.289454:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8269880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148544:0@lo:106: 00000100:00100000:1.0:1789891176.289455:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148416 00000100:00100000:1.0:1789891176.289460:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148416 00000100:00100000:0.0:1789891176.289493:0:5769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891176.289504:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148544 00000100:00100000:1.0:1789891176.289507:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148544 00000100:00100000:0.0:1789891176.289517:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff9cd2ce39f000 going to sleep for 11 seconds 00000100:00100000:3.0:1789891176.289529:0:11158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:5769:x1876835061148288:12345-0@lo:106: Request processed in 98us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.289529:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1789891176.289541:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148288:0@lo:106: 00000100:00100000:3.0:1789891176.289542:0:11158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:1.0:1789891176.289544:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c85ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:5769:x1876835061148416:12345-0@lo:106: 00010000:00010000:1.0:1789891176.289555:0:5754:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3c1523200/0x5bc033517ba2f8a3 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f8aa expref: -99 pid: 14208 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891176.289564:0:5754:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3c1523200/0x5bc033517ba2f8a3 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f8aa expref: -99 pid: 14208 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891176.289565:0:11158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:3.0:1789891176.289575:0:11158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5769:x1876835061148544:12345-0@lo:106: 00010000:00010000:3.0:1789891176.289582:0:11158:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3ef266e00/0x5bc033517ba2f848 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f85d expref: -99 pid: 14198 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891176.289587:0:11158:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9cd3ef266e00/0x5bc033517ba2f848 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bc033517ba2f85d expref: -99 pid: 14198 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789891176.289624:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c85ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:5769:x1876835061148416:12345-0@lo:106: Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.289632:0:11158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:5769:x1876835061148544:12345-0@lo:106: Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891176.289635:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:3.0:1789891176.289644:0:11158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1789891176.289780:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1876835061148672:0@lo:601:lquota_wb_lustr.0 00000100:00100000:1.0:1789891176.289813:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891176.289836:0:11763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148672 00000100:00100000:3.0:1789891176.289839:0:11763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148672 00000100:00100000:3.0:1789891176.289867:0:11763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11948 00000100:00100000:3.0:1789891176.289875:0:11763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+9:3292:x1876835061148672:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789891176.290349:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d826b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148416:0@lo:106: 00000100:00100000:0.0:1789891176.290362:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8269880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1876835061148544:0@lo:106: 00000100:00100000:0.0:1789891176.290435:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:85584:x1876835063060352:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 22256us (22386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891176.290444:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47444 00000100:00100000:3.0:1789891176.291057:0:11763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+9:3292:x1876835061148672:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 1184us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.291063:0:11763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11948 00000100:00100000:1.0:1789891176.291093:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1876835061148672:0@lo:601:lquota_wb_lustr.0 00010000:00010000:0.0:1789891176.291183:0:7453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.291190:0:7453:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.291200:0:7453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 3/1,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.291205:0:7453:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:0.0:1789891176.291218:0:7453:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789891176.291242:0:6582:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789891176.291248:0:6582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291263:0:6582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3d8e7be00 already unused, calling callback (ffffffffc1b79e90) 00040000:00010000:2.0:1789891176.291266:0:6582:0:(qsd_lock.c:340:qsd_id_blocking_ast()) ### blocking AST on ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291272:0:6582:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00040000:00010000:2.0:1789891176.291278:0:6582:0:(qsd_lock.c:349:qsd_id_blocking_ast()) ### canceling ID quota lock ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 3/0,0 mode: CR/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291301:0:6582:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 2/0,0 mode: --/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291306:0:6582:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789891176.291339:0:6582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 1/0,0 mode: --/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291344:0:6582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-lwp-OST0001 lock: ffff9cd3d8e7be00/0x5bc033517bb3adf7 lrc: 0/0,0 mode: --/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bc033517bb3adfe expref: -99 pid: 72917 timeout: 0 lvb_type: 2 lru_score: 1 lru_type: 0 00010000:00010000:2.0:1789891176.291361:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789891176.291362:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789891176.291365:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1789891176.291366:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789891176.291376:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061148800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789891176.291402:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891176.291434:0:8260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148800 00000100:00100000:2.0:1789891176.291439:0:8260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148800 00000100:00100000:2.0:1789891176.291484:0:8260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4227 00000100:00100000:2.0:1789891176.291492:0:8260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0001_UUID+9:3294:x1876835061148800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789891176.291501:0:8260:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789891176.291516:0:8260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ca00/0x5bc033517bb3adfe lrc: 0/0,0 mode: --/CR res: [0x200000006:0x1020000:0xea60].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bc033517bb3adf7 expref: 9 pid: 14207 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891176.291534:0:8260:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789891176.291564:0:8260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3294:x1876835061148800:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891176.291571:0:8260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4227 00000100:00100000:0.0:1789891176.291592:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061148800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789891176.303737:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891176.303790:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060480 00000100:00100000:1.0:1789891176.303800:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060480 00000100:00100000:1.0:1789891176.303854:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47445 00000100:00100000:1.0:1789891176.303871:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:85587:x1876835063060480:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:3.0:1789891176.313795:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:85587:x1876835063060480:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 9921us (10054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.313810:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47445 00000100:00100000:1.0:1789891176.327695:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891176.327763:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060608 00000100:00100000:2.0:1789891176.327774:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060608 00000100:00100000:2.0:1789891176.327831:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47446 00000100:00100000:2.0:1789891176.327842:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:85590:x1876835063060608:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:3.0:1789891176.330181:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:85590:x1876835063060608:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 2338us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.330192:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47446 00000100:00100000:1.0:1789891176.342268:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891176.342358:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060736 00000100:00100000:2.0:1789891176.342368:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060736 00000100:00100000:2.0:1789891176.342421:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47447 00000100:00100000:2.0:1789891176.342431:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:85593:x1876835063060736:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:2.0:1789891176.344478:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:85593:x1876835063060736:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 2035us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891176.344489:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47447 00000100:00100000:2.0:1789891176.350656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891176.350709:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060864 00000100:00100000:0.0:1789891176.350719:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060864 00000100:00100000:0.0:1789891176.350770:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47448 00000100:00100000:0.0:1789891176.350779:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:85594:x1876835063060864:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:0.0:1789891176.352517:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:85594:x1876835063060864:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 1735us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891176.352527:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47448 00000100:00100000:1.0:1789891176.359800:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891176.359857:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063060992 00000100:00100000:3.0:1789891176.359866:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063060992 00000100:00100000:3.0:1789891176.359918:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47449 00000100:00100000:3.0:1789891176.359928:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:85595:x1876835063060992:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:3.0:1789891176.361749:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:85595:x1876835063060992:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 1821us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.361759:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47449 00000100:00100000:1.0:1789891176.367677:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891176.367717:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061120 00000100:00100000:3.0:1789891176.367732:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061120 00000100:00100000:3.0:1789891176.367775:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47450 00000100:00100000:3.0:1789891176.367782:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ef43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:85596:x1876835063061120:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:3.0:1789891176.369413:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ef43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+6:85596:x1876835063061120:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 1629us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891176.369421:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47450 00010000:00010000:1.0:1789891176.515489:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891177.347515:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061148928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789891177.347583:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891177.347640:0:10272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061148928 00000100:00100000:2.0:1789891177.347649:0:10272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061148928 00000100:00080000:1.0:1789891177.347686:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789891177.347721:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1789891177.347734:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061148928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789891177.347768:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1789891177.347823:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061148928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891177.347846:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1789891177.347859:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061148928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789891177.539496:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891177.876975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891177.877031:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891177.877037:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061248 00000100:00100000:3.0:1789891177.877053:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061248 00000100:00100000:1.0:1789891177.877078:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891177.877084:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061376 00000100:00100000:0.0:1789891177.877091:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061376 00000100:00100000:1.0:1789891177.877119:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891177.877128:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3371 00000100:00100000:0.0:1789891177.877138:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1276 00000100:00100000:3.0:1789891177.877145:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c8443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063061248:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891177.877150:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063061376:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789891177.877163:0:72901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061632 00000100:00100000:1.0:1789891177.877168:0:72901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061632 00000100:00100000:1.0:1789891177.877220:0:72901:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061504 00000100:00100000:1.0:1789891177.877224:0:72901:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061504 00000100:00100000:0.0:1789891177.877232:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:2360:x1876835063061376:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891177.877238:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c8443050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2361:x1876835063061248:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891177.877253:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3371 00000100:00100000:0.0:1789891177.877257:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1276 00000100:00100000:1.0:1789891177.877266:0:72901:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 864 00000100:00100000:1.0:1789891177.877278:0:72901:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063061632:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891177.877299:0:6567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 865 00000100:00100000:0.0:1789891177.877310:0:6567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063061504:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:1.0:1789891177.877373:0:72901:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3f7dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:5327920f-5495-416f-9ae4-e5a29342d64d+5:2360:x1876835063061632:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891177.877382:0:6567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3f7dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5327920f-5495-416f-9ae4-e5a29342d64d+5:2361:x1876835063061504:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 72us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891177.877385:0:72901:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 864 00000100:00100000:0.0:1789891177.877396:0:6567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 865 00000100:00080000:1.0:1789891177.877415:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789891177.877422:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789891178.563413:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891178.883456:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061149056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789891178.883524:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891178.883567:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149056 00000100:00100000:3.0:1789891178.883576:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149056 00000100:00080000:0.0:1789891178.883611:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789891178.883640:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:3.0:1789891178.883652:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061149056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789891178.883688:0:6571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 125239296 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789891178.883740:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061149056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891178.883748:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1789891178.883780:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061149056:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789891179.587541:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789891180.016554:0:84250:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 16b: lfs quota should skip the nonexistent MDT/OST ========================================================== 03:59:39 (1789891179) 00000100:00100000:2.0:1789891180.419488:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c684762-cb06-47df-8ceb-1f58f3195acf:3292:1876835061149184:0@lo:400:kworker.0 00000100:00100000:3.0:1789891180.419518:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd2ce3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061149440:0@lo:400:kworker.0 00000100:00100000:1.0:1789891180.419519:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061149312:0@lo:400:kworker.0 00000100:00100000:2.0:1789891180.419595:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891180.419595:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891180.419600:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd2ce3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061149568:0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.419648:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149312 00000100:00100000:3.0:1789891180.419659:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891180.419659:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149312 00000100:00100000:1.0:1789891180.419673:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd308c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1876835061149824:0@lo:400:kworker.0 00000100:00100000:2.0:1789891180.419684:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd308c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061149696:0@lo:400:kworker.0 00000100:00100000:1.0:1789891180.419704:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891180.419723:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891180.419724:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149824 00000100:00100000:0.0:1789891180.419729:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149824 00000100:00100000:3.0:1789891180.419731:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149184 00000100:00100000:3.0:1789891180.419737:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149184 00000100:00100000:0.0:1789891180.419779:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1789891180.419780:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3372 00000100:00100000:3.0:1789891180.419799:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c8440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3292:x1876835061149184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.419799:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ff1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3293:x1876835061149312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891180.419869:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c8440850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3292:x1876835061149184:12345-0@lo:400:kworker.0 Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891180.419875:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3372 00000100:00100000:0.0:1789891180.419885:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ff1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3293:x1876835061149312:12345-0@lo:400:kworker.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891180.419894:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1789891180.419903:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1789891180.419905:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3ff1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3293:x1876835061149824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.419942:0:72919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149568 00000100:00100000:0.0:1789891180.419947:0:72919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149568 00000100:00100000:2.0:1789891180.419953:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3ff1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3293:x1876835061149824:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891180.419959:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1789891180.419963:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c684762-cb06-47df-8ceb-1f58f3195acf:3292:1876835061149184:0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.419982:0:72919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149696 00000100:00100000:2.0:1789891180.419987:0:72915:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1789891180.419988:0:72919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149696 00000100:00100000:2.0:1789891180.419997:0:72915:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061149568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789891180.420018:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891180.420026:0:72919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1789891180.420035:0:72915:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061149568:12345-0@lo:400:kworker.0 Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891180.420040:0:72919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061149696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891180.420045:0:72915:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:3.0:1789891180.420065:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149440 00000100:00100000:3.0:1789891180.420071:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149440 00000100:00100000:2.0:1789891180.420083:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd2ce3a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061149568:0@lo:400:kworker.0 00000100:00100000:1.0:1789891180.420108:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061149312:0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.420108:0:72919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061149696:12345-0@lo:400:kworker.0 Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891180.420114:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1789891180.420121:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd308c0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061149696:0@lo:400:kworker.0 00000100:00100000:0.0:1789891180.420127:0:72919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1789891180.420132:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd306f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+8:3294:x1876835061149440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891180.420135:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd308c0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1876835061149824:0@lo:400:kworker.0 00000100:00080000:2.0:1789891180.420158:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789891180.420163:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789891180.420166:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789891180.420190:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd306f9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+8:3294:x1876835061149440:12345-0@lo:400:kworker.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891180.420200:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:1.0:1789891180.420212:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd2ce3a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061149440:0@lo:400:kworker.0 00000001:02000400:0.0:1789891180.553768:0:84298:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-quota test_16b needs >= 3 MDTs 00010000:00010000:1.0:1789891180.613180:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789891181.093476:0:84346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 17: DQACQ return recoverable error == 03:59:41 (1789891181) 00010000:00010000:2.0:1789891181.635566:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891182.467526:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061149952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789891182.467602:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891182.467653:0:10272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061149952 00000100:00100000:1.0:1789891182.467668:0:10272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061149952 00000100:00080000:2.0:1789891182.467736:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891182.467751:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1789891182.467760:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061149952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789891182.467801:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 43057152 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789891182.467869:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061149952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891182.467874:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1789891182.467932:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061149952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789891182.659464:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891182.997147:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891182.997202:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891182.997231:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062016 00000100:00100000:1.0:1789891182.997234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891182.997245:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062016 00000100:00100000:3.0:1789891182.997248:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061760 00000100:00100000:3.0:1789891182.997255:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061760 00000100:00100000:1.0:1789891182.997278:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891182.997283:0:72896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063061888 00000100:00100000:2.0:1789891182.997289:0:72896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063061888 00000100:00100000:3.0:1789891182.997361:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3373 00000100:00100000:0.0:1789891182.997361:0:7578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062144 00000100:00100000:0.0:1789891182.997367:0:7578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062144 00000100:00100000:1.0:1789891182.997369:0:72925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7820 00000100:00100000:3.0:1789891182.997379:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c8441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2359:x1876835063061760:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:2.0:1789891182.997381:0:72896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1280 00000100:00100000:1.0:1789891182.997388:0:72925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ce814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:5327920f-5495-416f-9ae4-e5a29342d64d+5:2357:x1876835063062016:12345-192.168.204.32@tcp:9:kworker.0 00000100:00100000:2.0:1789891182.997396:0:72896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2c21b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5327920f-5495-416f-9ae4-e5a29342d64d+6:2358:x1876835063061888:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891182.997409:0:7578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 7821 00000100:00100000:0.0:1789891182.997421:0:7578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3076d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5327920f-5495-416f-9ae4-e5a29342d64d+5:2357:x1876835063062144:12345-192.168.204.32@tcp:9:kworker.0 00000020:00000080:1.0:1789891182.997422:0:72925:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5bc033517bb3ae05 00000100:00080000:1.0:1789891182.997435:0:72925:0:(import.c:65:import_set_state_nolock()) ffff9cd3f66ee000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789891182.997442:0:7578:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5bc033517bb3addb 00000100:00080000:0.0:1789891182.997452:0:7578:0:(import.c:65:import_set_state_nolock()) ffff9cd2c233f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789891182.997470:0:72896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2c21b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5327920f-5495-416f-9ae4-e5a29342d64d+6:2358:x1876835063061888:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 79us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891182.997475:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c8441050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2359:x1876835063061760:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891182.997481:0:72896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1280 00000100:00100000:3.0:1789891182.997487:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3373 00000001:00000004:1.0:1789891182.997487:0:72925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000001:00000004:0.0:1789891182.997495:0:7578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969952 00000100:00080000:3.0:1789891182.997544:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789891182.997551:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789891182.997555:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789891182.997576:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789891182.997597:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891182.997911:0:72925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ce814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:5327920f-5495-416f-9ae4-e5a29342d64d+2:2357:x1876835063062016:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 531us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891182.997913:0:7578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3076d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5327920f-5495-416f-9ae4-e5a29342d64d+2:2357:x1876835063062144:12345-192.168.204.32@tcp:9:kworker.0 Request processed in 493us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891182.997926:0:72925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7820 00000100:00100000:0.0:1789891182.997938:0:7578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 7821 00010000:00010000:2.0:1789891183.683495:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891184.003577:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789891184.003609:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061150080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789891184.003716:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891184.003771:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150080 00000100:00100000:3.0:1789891184.003784:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150080 00000100:00080000:2.0:1789891184.003840:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789891184.003873:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1789891184.003888:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d8269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061150080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789891184.003938:0:6571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 36634624 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789891184.003997:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d8269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061150080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891184.004005:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1789891184.004049:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061150080:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789891184.707528:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789891185.539602:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c684762-cb06-47df-8ceb-1f58f3195acf:3292:1876835061150208:0@lo:400:kworker.0 00000100:00100000:1.0:1789891185.539615:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061150336:0@lo:400:kworker.0 00000100:00100000:2.0:1789891185.539625:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061150592:0@lo:400:kworker.0 00000100:00100000:3.0:1789891185.539663:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061150464:0@lo:400:kworker.0 00000100:00100000:0.0:1789891185.539704:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891185.539710:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891185.539714:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891185.539738:0:5764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150208 00000100:00100000:3.0:1789891185.539749:0:5764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150208 00000100:00100000:0.0:1789891185.539788:0:3292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061150720:0@lo:400:kworker.0 00000100:00100000:1.0:1789891185.539792:0:3293:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1876835061150848:0@lo:400:kworker.0 00000100:00100000:2.0:1789891185.539800:0:40373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150592 00000100:00100000:2.0:1789891185.539804:0:40373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150592 00000100:00100000:3.0:1789891185.539819:0:5764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3374 00000100:00100000:0.0:1789891185.539829:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789891185.539834:0:5764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c8442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3292:x1876835061150208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891185.539837:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891185.539859:0:40373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150720 00000100:00100000:2.0:1789891185.539862:0:40373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150720 00000100:00100000:1.0:1789891185.539882:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150336 00000100:00100000:2.0:1789891185.539896:0:40373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1789891185.539903:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150336 00000100:00100000:2.0:1789891185.539905:0:40373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061150592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891185.539910:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150848 00000100:00100000:3.0:1789891185.539914:0:5764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c8442050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c684762-cb06-47df-8ceb-1f58f3195acf+19:3292:x1876835061150208:12345-0@lo:400:kworker.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891185.539917:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150848 00000100:00100000:3.0:1789891185.539925:0:5764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3374 00000100:00100000:2.0:1789891185.539952:0:40373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061150592:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891185.539952:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:2.0:1789891185.539961:0:40373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1789891185.539966:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3076d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3293:x1876835061150336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789891185.539976:0:40373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:3.0:1789891185.539983:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789891185.539987:0:40373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d826bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061150720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789891185.539991:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:0.0:1789891185.540005:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3076d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3293:x1876835061150848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891185.540024:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3076d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3293:x1876835061150336:12345-0@lo:400:kworker.0 Request processed in 61us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891185.540033:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150464 00000100:00100000:1.0:1789891185.540033:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1789891185.540039:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150464 00000100:00100000:2.0:1789891185.540067:0:40373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d826bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3292:x1876835061150720:12345-0@lo:400:kworker.0 Request processed in 83us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891185.540075:0:40373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1789891185.540082:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3076d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3293:x1876835061150848:12345-0@lo:400:kworker.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891185.540084:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1789891185.540085:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3f7dbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1876835061150848:0@lo:400:kworker.0 00000100:00100000:0.0:1789891185.540101:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1789891185.540102:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2ca361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+8:3294:x1876835061150464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789891185.540105:0:3293:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1876835061150336:0@lo:400:kworker.0 00000100:00100000:2.0:1789891185.540125:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061150592:0@lo:400:kworker.0 00000100:00080000:0.0:1789891185.540139:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789891185.540146:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891185.540162:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3f7dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1876835061150720:0@lo:400:kworker.0 00000100:00100000:3.0:1789891185.540165:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2ca361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+8:3294:x1876835061150464:12345-0@lo:400:kworker.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891185.540176:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1789891185.540177:0:3292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c684762-cb06-47df-8ceb-1f58f3195acf:3292:1876835061150208:0@lo:400:kworker.0 00000100:00100000:2.0:1789891185.540184:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd306f9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1876835061150464:0@lo:400:kworker.0 00010000:00010000:3.0:1789891185.731510:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789891186.580070:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5327920f-5495-416f-9ae4-e5a29342d64d 00000020:00000080:0.0:1789891186.580079:0:7454:0:(genops.c:906:class_export_put()) final put ffff9cd2c2338000/5327920f-5495-416f-9ae4-e5a29342d64d 00000020:00000080:3.0:1789891186.580110:0:71719:0:(genops.c:865:class_export_destroy()) destroying export ffff9cd2c2338000/5327920f-5495-416f-9ae4-e5a29342d64d for lustre-OST0001 00000020:00000080:3.0:1789891186.580176:0:71719:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cd2c233f800 for lustre-OST0001 00000001:00100000:3.0:1789891186.584191:0:80393:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5327920f-5495-416f-9ae4-e5a29342d64d 00000020:00000080:3.0:1789891186.584201:0:80393:0:(genops.c:906:class_export_put()) final put ffff9cd3f66ea000/5327920f-5495-416f-9ae4-e5a29342d64d 00000020:00000080:0.0:1789891186.584240:0:71719:0:(genops.c:865:class_export_destroy()) destroying export ffff9cd3f66ea000/5327920f-5495-416f-9ae4-e5a29342d64d for lustre-OST0000 00000020:00000080:0.0:1789891186.584339:0:71719:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9cd3f66ee000 for lustre-OST0000 00010000:00010000:3.0:1789891186.756497:0:6582:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789891187.385370:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891187.385450:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062272 00000100:00100000:1.0:1789891187.385460:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062272 00000100:00100000:1.0:1789891187.385530:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47451 00000100:00100000:1.0:1789891187.385543:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3076d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:86324:x1876835063062272:12345-192.168.204.32@tcp:101:lfs.0 00010000:00010000:1.0:1789891187.385562:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789891187.385589:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3aede lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f232f expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.386171:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.386188:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.386203:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789891187.386544:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789891187.387454:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.387477:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.387491:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388404:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388413:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388423:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388433:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1c200 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:1.0:1789891187.388441:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388452:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388471:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:1.0:1789891187.388474:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789891187.388481:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388487:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1c200/0x5bc033517bb3aee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388505:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388510:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388515:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388520:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd307f1da00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:1.0:1789891187.388522:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388525:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388536:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x101cb3e6 (ffff9cd3d8e4eb00) 00010000:00010000:1.0:1789891187.388539:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789891187.388542:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388546:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1da00/0x5bc033517bb3aeec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388606:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3aede lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f232f expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388617:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:1.0:1789891187.388620:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789891187.388627:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd307f1ce00/0x5bc033517bb3aede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f232f expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789891187.388639:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd307f1ce00, rc 0) 00000100:00100000:1.0:1789891187.389915:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3076d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+6:86324:x1876835063062272:12345-192.168.204.32@tcp:101:lfs.0 Request processed in 4365us (4543us total) trans 0 rc 301/301 00000100:00100000:1.0:1789891187.389925:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47451 00000100:00100000:2.0:1789891187.392175:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891187.392232:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062528 00000100:00100000:3.0:1789891187.392257:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062528 00000100:00100000:3.0:1789891187.392396:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47452 00000100:00100000:3.0:1789891187.392413:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+6:86324:x1876835063062528:12345-192.168.204.32@tcp:36:lfs.0 00010000:00010000:3.0:1789891187.392479:0:6593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789891187.392517:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3000/0x5bc033517bb3aebb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2321 expref: 6 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.392540:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c700) 00010000:00010000:3.0:1789891187.392552:0:6593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789891187.392971:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.392985:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.392998:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.393021:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.393029:0:6593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.393039:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789891187.394643:0:6593:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc3:0x0]: returning size 512 00010000:00010000:3.0:1789891187.394656:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394665:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394672:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394678:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512e00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891187.394683:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394691:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394702:0:6593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30715c400) 00010000:00010000:3.0:1789891187.394705:0:6593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891187.394709:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.394715:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3aef3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789891187.394737:0:6593:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000057a35405 reply state 000000008c7232f8 transno 4294996369 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789891187.394746:0:6593:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789891187.394855:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+7:86324:x1876835063062528:12345-192.168.204.32@tcp:36:lfs.0 Request processed in 2447us (2686us total) trans 4294996369 rc 0/0 00000100:00100000:3.0:1789891187.394874:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47452 00010000:00010000:2.0:1789891187.395684:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395701:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395711:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395719:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512c00 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:2.0:1789891187.395725:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395734:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395753:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x101cb3e6 (ffff9cd30715c200) 00010000:00010000:2.0:1789891187.395756:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789891187.395760:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.395766:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512c00/0x5bc033517bb3aefa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6593 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789891187.399914:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:2.0:1789891187.400475:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062656 00000100:00100000:2.0:1789891187.400488:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062656 00000100:00100000:2.0:1789891187.400552:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47453 00000100:00100000:2.0:1789891187.400564:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:86325:x1876835063062656:12345-192.168.204.32@tcp:101:chmod.0 00010000:00010000:2.0:1789891187.400592:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789891187.400614:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e2e00/0x5bc033517bb3af01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f2336 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400700:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3400/0x5bc033517bb3af08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400715:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3400/0x5bc033517bb3af08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400728:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3400/0x5bc033517bb3af08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789891187.400789:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789891187.400793:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789891187.400818:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3400/0x5bc033517bb3af08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400845:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e2e00/0x5bc033517bb3af01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2336 expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400864:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3083e3400/0x5bc033517bb3af08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f2336 expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789891187.400886:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c200) 00010000:00010000:2.0:1789891187.400890:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789891187.400895:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd3083e3400, rc 0) 00000100:00100000:2.0:1789891187.400969:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+7:86325:x1876835063062656:12345-192.168.204.32@tcp:101:chmod.0 Request processed in 406us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789891187.400978:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47453 00000100:00100000:2.0:1789891187.402187:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891187.402235:0:72965:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063062784 00000100:00100000:3.0:1789891187.402259:0:72965:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063062784 00000100:00100000:3.0:1789891187.402308:0:72965:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47454 00000100:00100000:3.0:1789891187.402354:0:72965:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+7:86325:x1876835063062784:12345-192.168.204.32@tcp:101:chmod.0 00010000:00010000:3.0:1789891187.402371:0:72965:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789891187.402389:0:72965:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3af0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb3f81cebc40f233d expref: -99 pid: 72965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402453:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402466:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402480:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402500:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402510:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402519:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402685:0:72965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402700:0:72965:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402708:0:72965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789891187.402760:0:72965:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc3:0x0]: returning size 512 00000004:00200000:3.0:1789891187.402764:0:72965:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789891187.402802:0:72965:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402814:0:72965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402818:0:72965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402823:0:72965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402830:0:72965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512600 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891187.402834:0:72965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402839:0:72965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402854:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cd30936c200) 00010000:00010000:3.0:1789891187.402857:0:72965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891187.402862:0:72965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402876:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512600/0x5bc033517bb3af16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402896:0:72965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402903:0:72965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402910:0:72965:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402918:0:72965:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6512800 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:3.0:1789891187.402922:0:72965:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402926:0:72965:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402937:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x101cb3e6 (ffff9cd30715c400) 00010000:00010000:3.0:1789891187.402940:0:72965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789891187.402942:0:72965:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402946:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512800/0x5bc033517bb3af1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x101cb3e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 72965 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.402982:0:72965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6512e00/0x5bc033517bb3af0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f233d expref: 9 pid: 72965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.403011:0:72965:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f233d expref: 8 pid: 72965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789891187.403018:0:72965:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc3:0x0].0x0 (ffff9cd30715c900) 00010000:00010000:3.0:1789891187.403021:0:72965:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789891187.403024:0:72965:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cd3c6513c00, rc 0) 00000100:00100000:3.0:1789891187.403088:0:72965:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:5327920f-5495-416f-9ae4-e5a29342d64d+8:86325:x1876835063062784:12345-192.168.204.32@tcp:101:chmod.0 Request processed in 771us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891187.403099:0:72965:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47454 00000100:00100000:3.0:1789891187.404277:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891187.404367:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063063040 00000100:00100000:0.0:1789891187.404375:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063063040 00000100:00100000:0.0:1789891187.404454:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47455 00000100:00100000:0.0:1789891187.404468:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd2c3dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+8:86325:x1876835063063040:12345-192.168.204.32@tcp:36:chmod.0 00010000:00010000:0.0:1789891187.404502:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789891187.404524:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6513c00/0x5bc033517bb3af24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.32@tcp remote: 0xb3f81cebc40f233d expref: 8 pid: 72965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.404540:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc3:0x0].0x0 (ffff9cd30715c900) 00010000:00010000:0.0:1789891187.404547:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789891187.404564:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.404574:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.404581:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789891187.404779:0:5769:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 0000000014e111f2 reply state 0000000061355e0a transno 4294996370 ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789891187.404789:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789891187.404811:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1fc3:0x0]: returning size 512 00000100:00100000:0.0:1789891187.404866:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd2c3dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5327920f-5495-416f-9ae4-e5a29342d64d+9:86325:x1876835063063040:12345-192.168.204.32@tcp:36:chmod.0 Request processed in 402us (590us total) trans 4294996370 rc 0/0 00000100:00100000:0.0:1789891187.404873:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47455 00010000:00010000:0.0:1789891187.406378:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406387:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406393:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406399:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cd3c6705600 already unused, calling callback (ffffffffc1e2e6d0) 00010000:00010000:0.0:1789891187.406402:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406408:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406418:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc3:0x0].0x0 (ffff9cd3c1321300) 00010000:00010000:0.0:1789891187.406420:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789891187.406423:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789891187.406427:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cd3c6705600/0x5bc033517bb3af2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fc3:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789891187.587849:0:3294:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d417e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061150976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789891187.587920:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789891187.587952:0:10272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061150976 00000100:00100000:1.0:1789891187.587959:0:10272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061150976 00000100:00080000:0.0:1789891187.587988:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789891187.588017:0:10272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1789891187.588029:0:10272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061150976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789891187.588057:0:10272:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1789891187.588117:0:10272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1876835061150976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891187.588128:0:10272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1789891187.588164:0:3294:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d417e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1876835061150976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789891187.780457:0:5759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891188.116790:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891188.116837:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063063168 00000100:00100000:2.0:1789891188.116841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:1.0:1789891188.116849:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063063168 00000100:00100000:0.0:1789891188.116894:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063063296 00000100:00100000:0.0:1789891188.116900:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063063296 00000100:00100000:1.0:1789891188.116914:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 3375 00000100:00100000:1.0:1789891188.116929:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c8442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2359:x1876835063063168:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891188.116945:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 1284 00000100:00100000:0.0:1789891188.116958:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+8:2358:x1876835063063296:12345-192.168.204.32@tcp:400:kworker.0 00000100:00100000:0.0:1789891188.117019:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5327920f-5495-416f-9ae4-e5a29342d64d+8:2358:x1876835063063296:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 64us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789891188.117021:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c8442450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70543a14-ccb9-4c3b-9797-7c34228642a8+10:2359:x1876835063063168:12345-192.168.204.32@tcp:400:kworker.0 Request processed in 95us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891188.117036:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 1284 00000100:00100000:1.0:1789891188.117037:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 3375 00000001:00080000:2.0:1789891188.282650:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294996370 is committed 00000004:00080000:1.0:1789891188.710377:0:84694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1877059058014ns, next at 1803970745287ns, rc = 0 00000004:00080000:1.0:1789891188.710507:0:84694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1877059190678ns, next at 1850448125964ns, rc = 0 00000004:00080000:3.0:1789891188.711640:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 305 committed 00000004:00080000:3.0:1789891188.712227:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 269 committed 00010000:00010000:2.0:1789891188.804401:0:6583:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789891189.124480:0:3291:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9cd3d8269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061151104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789891189.124580:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789891189.124632:0:6571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835061151104 00000100:00100000:0.0:1789891189.124641:0:6571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835061151104 00000100:00100000:0.0:1789891189.124715:0:6571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1789891189.124728:0:6571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3c2da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061151104:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789891189.124733:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1789891189.124764:0:6571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 36634624 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789891189.124854:0:6571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3c2da1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1876835061151104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891189.124861:0:6571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1789891189.124911:0:3291:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9cd3d8269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1876835061151104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789891189.161041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:0.0:1789891189.161099:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063063424 00000100:00100000:0.0:1789891189.161109:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063063424 00000100:00080000:1.0:1789891189.161154:0:5766:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789891189.161173:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47456 00000100:00100000:0.0:1789891189.161184:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:86584:x1876835063063424:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:0.0:1789891189.161297:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5327920f-5495-416f-9ae4-e5a29342d64d+6:86584:x1876835063063424:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789891189.161302:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47456 00000100:00100000:2.0:1789891189.170044:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.32@tcp (source: 12345-192.168.204.32@tcp) 00000100:00100000:3.0:1789891189.170098:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835063063552 00000100:00100000:3.0:1789891189.170114:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835063063552 00000100:00100000:3.0:1789891189.170193:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.32@tcp, seq: 47457 00000100:00100000:3.0:1789891189.170207:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cd3d417fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+6:86586:x1876835063063552:12345-192.168.204.32@tcp:48:lfs.0 00000100:00100000:3.0:1789891189.170590:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cd3d417fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5327920f-5495-416f-9ae4-e5a29342d64d+6:86586:x1876835063063552:12345-192.168.204.32@tcp:48:lfs.0 Request processed in 386us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789891189.170602:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.32@tcp, seq: 47457 00000001:02000400:3.0:1789891189.636956:0:84791:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_17: @@@@@@ FAIL: Used space(30069) for user quota_usr isn't 0. 00010000:00010000:3.0:1789891189.827556:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1537 lines, 1537 kept, 0 dropped, 0 bad.