00010000:00010000:1.0F:1789890340.418829:0:5566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0F:1789890341.442854:0:6024:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1789890342.466899:0:42497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789890343.362962:0:2354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:194b88b9-1a8c-4aec-999d-75f5c9edbb16:2354:1876834884450816:192.168.201.112@tcp:400:kworker.0 00000100:00100000:0.0F:1789890343.363017:0:2355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884450688:192.168.201.112@tcp:400:kworker.0 00000100:00100000:0.0:1789890343.364868:0:2355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884450688:192.168.201.112@tcp:400:kworker.0 00000100:00100000:1.0:1789890343.364892:0:2354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:194b88b9-1a8c-4aec-999d-75f5c9edbb16:2354:1876834884450816:192.168.201.112@tcp:400:kworker.0 00010000:00010000:2.0:1789890343.490898:0:5567:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789890344.515828:0:42498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789890345.042371:0:58352:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 3b: Quota pools: Block soft limit (start timer, expires, stop timer) ========================================================== 03:45:44 (1789890344) 00010000:00010000:1.0:1789890345.538843:0:5566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789890345.871292:0:2348:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.112@tcp (source: 12345-192.168.201.112@tcp) 00000100:00100000:2.0:1789890345.871358:0:2348:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.112@tcp (source: 12345-192.168.201.112@tcp) 00000100:00100000:3.0:1789890345.871372:0:5559:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834888211328 00000100:00100000:3.0:1789890345.871385:0:5559:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834888211328 00000100:00100000:2.0:1789890345.871389:0:5558:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876834888211456 00000100:00100000:2.0:1789890345.871396:0:5558:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876834888211456 00000100:00100000:2.0:1789890345.871450:0:5558:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.112@tcp, seq: 792 00000100:00100000:3.0:1789890345.871464:0:5559:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.112@tcp, seq: 793 00000100:00100000:2.0:1789890345.871466:0:5558:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9262605b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:d82bcf0e-cd20-424f-9df3-6f177948f745+4:56894:x1876834888211456:12345-192.168.201.112@tcp:104: 00000100:00100000:3.0:1789890345.871477:0:5559:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9262605b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:d82bcf0e-cd20-424f-9df3-6f177948f745+4:56894:x1876834888211328:12345-192.168.201.112@tcp:104: 00010000:00010000:2.0:1789890345.871488:0:5558:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789890345.871489:0:5559:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789890345.871577:0:5559:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789890345.871583:0:5559:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9262605b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_001:d82bcf0e-cd20-424f-9df3-6f177948f745+4:56894:x1876834888211328:12345-192.168.201.112@tcp:104: Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789890345.871589:0:5559:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.112@tcp, seq: 793 00010000:00010000:2.0:1789890345.871594:0:5558:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789890345.871604:0:5558:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9262605b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:d82bcf0e-cd20-424f-9df3-6f177948f745+3:56894:x1876834888211456:12345-192.168.201.112@tcp:104: Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789890345.871613:0:5558:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.112@tcp, seq: 792 00010000:00010000:1.0:1789890345.871761:0:42497:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789890345.871768:0:6024:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789890345.871782:0:42497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890345.871783:0:6024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890345.871825:0:42497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926259566e00 already unused, calling callback (ffffffffc1418c20) 00010000:00010000:0.0:1789890345.871826:0:6024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff926259567e00 already unused, calling callback (ffffffffc1418c20) 10000000:00010000:0.0:1789890345.871839:0:6024:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789890345.871841:0:42497:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890345.871899:0:6024:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890345.871900:0:42497:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789890345.871941:0:6024:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789890345.871943:0:42497:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789890345.872023:0:6024:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789890345.872024:0:42497:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789890345.872122:0:42497:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890345.872123:0:6024:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890345.872154:0:42497:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789890345.872155:0:6024:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789890345.872209:0:6024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890345.872210:0:42497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890345.872241:0:6024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff926259567e00/0x3f86977308edcd25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e71107 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890345.872244:0:42497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff926259566e00/0x3f86977308edcd2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc7ae9dee32e7110e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890345.872287:0:6024:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789890345.872293:0:6024:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789890345.872314:0:6024:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789890345.872326:0:42497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789890345.872331:0:42497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789890345.872335:0:42497:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789890345.872363:0:2354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82bcf0e-cd20-424f-9df3-6f177948f745:2354:1876834884451072:192.168.201.112@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789890345.872365:0:2355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884450944:192.168.201.112@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789890345.875815:0:2354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d82bcf0e-cd20-424f-9df3-6f177948f745:2354:1876834884451072:192.168.201.112@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789890345.877403:0:2355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884450944:192.168.201.112@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789890346.562902:0:5567:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789890347.587759:0:5569:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789890347.587767:0:5569:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9262604ca800 from 194 10000000:01000000:2.0:1789890347.587773:0:5569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789890347.587831:0:5569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789890347.587845:0:5569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789890347.587858:0:5569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789890347.587891:0:5569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9262605b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451200:192.168.201.112@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789890347.588037:0:5569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262500a8d80 going to sleep for 11 seconds 00010000:00010000:3.0:1789890347.588811:0:42498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789890347.589531:0:5569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9262605b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451200:192.168.201.112@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789890347.589557:0:5569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e7117e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890347.589570:0:5569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc7ae9dee32e7117e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789890347.589639:0:5569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451328:192.168.201.112@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789890347.590089:0:5569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262500c5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789890347.591451:0:5569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451328:192.168.201.112@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789890347.591505:0:5569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451456:192.168.201.112@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789890347.591592:0:5569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262500c5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789890347.592818:0:5569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451456:192.168.201.112@tcp:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789890347.593946:0:58507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 192 00000020:01000000:1.0:1789890347.594041:0:5569:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 194-193 (rc=0) 10000000:01000000:1.0:1789890347.594068:0:5569:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789890347.594077:0:5569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e7117e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890347.594088:0:5569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff926259566800/0x3f86977308edcd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e7117e expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789890347.594097:0:5569:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789890347.594099:0:5569:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9262604799c0 from 1 10000000:01000000:1.0:1789890347.594101:0:5569:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789890347.594124:0:5569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890347.594132:0:5569:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789890347.594139:0:5569:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789890347.594154:0:5569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451584:192.168.201.112@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789890347.594210:0:5569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262592c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789890347.595387:0:5569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451584:192.168.201.112@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789890347.595404:0:5569:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e71185 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890347.595414:0:5569:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc7ae9dee32e71185 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789890347.595482:0:5569:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451712:192.168.201.112@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789890347.595541:0:5569:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262500c5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789890347.596782:0:5569:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d82bcf0e-cd20-424f-9df3-6f177948f745:5569:1876834884451712:192.168.201.112@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789890347.596828:0:5569:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789890347.596834:0:5569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e71185 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789890347.596843:0:5569:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff926248235400/0x3f86977308edcd3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc7ae9dee32e71185 expref: -99 pid: 5569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789890348.483017:0:2355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884451840:192.168.201.112@tcp:400:kworker.0 00000100:00100000:1.0:1789890348.483185:0:2355:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789890348.483198:0:2355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:194b88b9-1a8c-4aec-999d-75f5c9edbb16:2355:1876834884451968:192.168.201.112@tcp:400:kworker.0 00000100:00100000:1.0:1789890348.484999:0:2355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d82bcf0e-cd20-424f-9df3-6f177948f745:2355:1876834884451840:192.168.201.112@tcp:400:kworker.0 00000100:00100000:1.0:1789890348.485440:0:2355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:194b88b9-1a8c-4aec-999d-75f5c9edbb16:2355:1876834884451968:192.168.201.112@tcp:400:kworker.0 00010000:00010000:1.0:1789890348.619035:0:5566:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000080:00200008:1.0:1789890348.943405:0:58637:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1789890348.943419:0:58637:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:1.0:1789890348.943439:0:58637:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1789890348.943462:0:58637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:1.0:1789890348.943477:0:58637:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:1.0:1789890348.943484:0:58637:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1789890348.943490:0:58637:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:1.0:1789890348.943494:0:58637:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:1.0:1789890348.943502:0:58637:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1f9fcb8 00010000:00010000:1.0:1789890348.943505:0:58637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:1.0:1789890348.943512:0:58637:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200008:1.0:1789890348.943968:0:58637:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), request_mask 0, flags 0, foreign 0 00000080:00200000:1.0:1789890348.943977:0:58637:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:1.0:1789890348.943983:0:58637:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1789890348.943990:0:58637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:1.0:1789890348.943997:0:58637:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:1.0:1789890348.944002:0:58637:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1789890348.944006:0:58637:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:1.0:1789890348.944008:0:58637:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:1.0:1789890348.944028:0:58637:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1f9fcb8 00010000:00010000:1.0:1789890348.944031:0:58637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:1.0:1789890348.944038:0:58637:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:1.0:1789890348.944137:0:58637:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:1.0:1789890348.944143:0:58637:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:1.0:1789890348.944149:0:58637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:1.0:1789890348.944155:0:58637:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:1.0:1789890348.944160:0:58637:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:1.0:1789890348.944163:0:58637:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:1.0:1789890348.944168:0:58637:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:1.0:1789890348.944171:0:58637:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1f9fbb0 00010000:00010000:1.0:1789890348.944173:0:58637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:1.0:1789890348.944178:0:58637:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:1.0:1789890348.944184:0:58637:0:(file.c:6650:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8), inode mode 41ed mask 44 00000080:00200008:1.0:1789890348.944190:0:58637:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), flags 300000 00000080:00200080:1.0:1789890348.944204:0:58637:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8) cmd=c0b066a2 arg=ac0180 00000100:00100000:1.0:1789890348.944259:0:58637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926250a62d80 pname:cluuid:pid:xid:nid:opc:job lfs:194b88b9-1a8c-4aec-999d-75f5c9edbb16:58637:1876834884452096:192.168.201.112@tcp:48:lfs.0 00000100:00100000:1.0:1789890348.944346:0:58637:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262592c8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789890348.945438:0:58637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926250a62d80 pname:cluuid:pid:xid:nid:opc:job lfs:194b88b9-1a8c-4aec-999d-75f5c9edbb16:58637:1876834884452096:192.168.201.112@tcp:48:lfs.0 00000080:00200008:1.0:1789890348.945464:0:58637:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), flags 300000 00000080:00200008:0.0:1789890348.952174:0:58639:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1789890348.952183:0:58639:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:0.0:1789890348.952198:0:58639:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789890348.952213:0:58639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:0.0:1789890348.952226:0:58639:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:0.0:1789890348.952232:0:58639:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789890348.952238:0:58639:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:0.0:1789890348.952240:0:58639:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:0.0:1789890348.952246:0:58639:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1defcb8 00010000:00010000:0.0:1789890348.952249:0:58639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:0.0:1789890348.952263:0:58639:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200008:0.0:1789890348.952619:0:58639:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1789890348.952623:0:58639:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:0.0:1789890348.952629:0:58639:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789890348.952635:0:58639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:0.0:1789890348.952642:0:58639:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:0.0:1789890348.952646:0:58639:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789890348.952650:0:58639:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:0.0:1789890348.952652:0:58639:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:0.0:1789890348.952655:0:58639:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1defcb8 00010000:00010000:0.0:1789890348.952657:0:58639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:0.0:1789890348.952662:0:58639:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:0.0:1789890348.952761:0:58639:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8),name=/ 00000002:00010000:0.0:1789890348.952769:0:58639:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789890348.952775:0:58639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:0.0:1789890348.952790:0:58639:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:0.0:1789890348.952795:0:58639:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789890348.952799:0:58639:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) 00000080:00010000:0.0:1789890348.952801:0:58639:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff926258d100c8) for lock 0x3f86977308edcd10 00000080:00010000:0.0:1789890348.952804:0:58639:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x3f86977308edcd10 from it ffffab03c1defbb0 00010000:00010000:0.0:1789890348.952806:0:58639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:0.0:1789890348.952811:0:58639:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9262604ca800 lock: ffff926259567800/0x3f86977308edcd10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc7ae9dee32e71066 expref: -99 pid: 55598 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:0.0:1789890348.952818:0:58639:0:(file.c:6650:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8), inode mode 41ed mask 44 00000080:00200008:0.0:1789890348.952824:0:58639:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), flags 300000 00000080:00200080:0.0:1789890348.952835:0:58639:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff926258d100c8) cmd=c0b066a2 arg=2273180 00000100:00100000:0.0:1789890348.952873:0:58639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job lfs:194b88b9-1a8c-4aec-999d-75f5c9edbb16:58639:1876834884452224:192.168.201.112@tcp:48:lfs.0 00000100:00100000:0.0:1789890348.952952:0:58639:0:(client.c:2702:ptlrpc_set_wait()) set ffff9262500c5180 going to sleep for 11 seconds 00000100:00100000:0.0:1789890348.953928:0:58639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff926258b6c000 pname:cluuid:pid:xid:nid:opc:job lfs:194b88b9-1a8c-4aec-999d-75f5c9edbb16:58639:1876834884452224:192.168.201.112@tcp:48:lfs.0 00000080:00200008:0.0:1789890348.953963:0:58639:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff926258d100c8), flags 300000 00000001:02000400:3.0:1789890349.442398:0:58765:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_3b: @@@@@@ FAIL: Used space(28839) for user quota_usr isn't 0. 00010000:00010000:3.0:1789890349.634909:0:6024:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 188 lines, 188 kept, 0 dropped, 0 bad.