00010000:00010000:3.0F:1789893048.055382:0:43693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1789893048.311418:0:2401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2401:1876837985760640:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0F:1789893048.311437:0:2402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2402:1876837985760768:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0:1789893048.311557:0:2402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2402:1876837985761024:192.168.202.144@tcp:400:kworker.0 00000100:00100000:0.0:1789893048.311565:0:2401:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2401:1876837985760896:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0:1789893048.312985:0:2401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0f18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2401:1876837985760640:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0:1789893048.313478:0:2402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0f18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2402:1876837985760768:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0:1789893048.313494:0:2402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0f19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2402:1876837985761024:192.168.202.144@tcp:400:kworker.0 00000100:00100000:0.0:1789893048.313514:0:2401:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0f18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2401:1876837985760896:192.168.202.144@tcp:400:kworker.0 00010000:00010000:0.0:1789893049.080385:0:6158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0F:1789893049.921336:0:63544:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 3b: Quota pools: Block soft limit (start timer, expires, stop timer) ========================================================== 04:30:49 (1789893049) 00010000:00010000:2.0:1789893050.103301:0:13808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789893050.540870:0:2393:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.144@tcp (source: 12345-192.168.202.144@tcp) 00000100:00100000:0.0:1789893050.540933:0:2393:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.144@tcp (source: 12345-192.168.202.144@tcp) 00000100:00100000:1.0:1789893050.540963:0:6149:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789893050.540985:0:6149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876837990666368 00000100:00100000:1.0:1789893050.540996:0:6149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876837990666368 00000100:00100000:2.0:1789893050.540999:0:6150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876837990666624 00000100:00100000:2.0:1789893050.541008:0:6150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876837990666624 00000100:00100000:1.0:1789893050.541057:0:6149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.144@tcp, seq: 806 00000100:00100000:2.0:1789893050.541062:0:6150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.144@tcp, seq: 8 00000100:00100000:1.0:1789893050.541076:0:6149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f67c5cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f1325ce9-2b61-4bd9-a3a0-e7708978b358+4:63738:x1876837990666368:12345-192.168.202.144@tcp:104: 00000100:00100000:2.0:1789893050.541077:0:6150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f67c5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f1325ce9-2b61-4bd9-a3a0-e7708978b358+4:63738:x1876837990666624:12345-192.168.202.144@tcp:104: 00010000:00010000:2.0:1789893050.541108:0:6150:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789893050.541108:0:6149:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893050.541238:0:6150:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789893050.541246:0:6150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f67c5bb9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb01_000:f1325ce9-2b61-4bd9-a3a0-e7708978b358+4:63738:x1876837990666624:12345-192.168.202.144@tcp:104: Request processed in 175us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789893050.541254:0:6150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.144@tcp, seq: 8 00010000:00010000:1.0:1789893050.541257:0:6149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789893050.541261:0:6159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789893050.541272:0:6159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789893050.541272:0:6149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f67c5cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f1325ce9-2b61-4bd9-a3a0-e7708978b358+4:63738:x1876837990666368:12345-192.168.202.144@tcp:104: Request processed in 199us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789893050.541292:0:6149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.144@tcp, seq: 806 00010000:00010000:2.0:1789893050.541299:0:43693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789893050.541301:0:6159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f67c372e400 already unused, calling callback (ffffffffc1142c20) 00010000:00010000:2.0:1789893050.541305:0:43693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789893050.541307:0:6159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893050.541325:0:43693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f67d0c17c00 already unused, calling callback (ffffffffc1142c20) 00010000:00010000:3.0:1789893050.541328:0:6159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789893050.541329:0:43693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789893050.541354:0:6159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893050.541354:0:43693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789893050.541365:0:43693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789893050.541369:0:43693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789893050.541411:0:43693:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789893050.541413:0:6159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789893050.541442:0:43693:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789893050.541448:0:6159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789893050.541457:0:6159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789893050.541467:0:43693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789893050.541470:0:6159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893050.541476:0:43693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff8f67d0c17c00/0xbcfa502c8eff4311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffc2 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789893050.541489:0:6159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff8f67c372e400/0xbcfa502c8eff430a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b36158ffbb expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893050.541496:0:43693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789893050.541499:0:43693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789893050.541500:0:43693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789893050.541509:0:6159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789893050.541512:0:6159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789893050.541515:0:6159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789893050.541518:0:2403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2403:1876837985761152:192.168.202.144@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789893050.541544:0:2404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2404:1876837985761280:192.168.202.144@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789893050.542704:0:2403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2403:1876837985761152:192.168.202.144@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789893050.543176:0:2404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2404:1876837985761280:192.168.202.144@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789893051.127337:0:6158:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789893052.152317:0:13808:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789893052.215284:0:6161:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789893052.215296:0:6161:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8f67c434c000 from 205 10000000:01000000:1.0:1789893052.215304:0:6161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789893052.215367:0:6161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789893052.215383:0:6161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789893052.215414:0:6161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789893052.215454:0:6161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761408:192.168.202.144@tcp:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789893052.215581:0:6161:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67d0c32540 going to sleep for 11 seconds 00000100:00100000:2.0:1789893052.217040:0:6161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0f19f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761408:192.168.202.144@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789893052.217068:0:6161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900cc expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893052.217082:0:6161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3615900cc expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789893052.217160:0:6161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761536:192.168.202.144@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789893052.217252:0:6161:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67c56dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789893052.218291:0:6161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761536:192.168.202.144@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789893052.218332:0:6161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761664:192.168.202.144@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789893052.218403:0:6161:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67c56dfd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789893052.219294:0:6161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761664:192.168.202.144@tcp:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789893052.220147:0:63732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 201 00000020:01000000:2.0:1789893052.220250:0:6161:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 205-204 (rc=0) 10000000:01000000:2.0:1789893052.220277:0:6161:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789893052.220288:0:6161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900cc expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893052.220301:0:6161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff8f67c5d0f800/0xbcfa502c8eff4318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900cc expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789893052.220312:0:6161:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789893052.220315:0:6161:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8f67e00fb380 from 1 10000000:01000000:2.0:1789893052.220318:0:6161:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789893052.220344:0:6161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893052.220353:0:6161:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789893052.220385:0:6161:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789893052.220405:0:6161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761792:192.168.202.144@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789893052.220455:0:6161:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67c56dfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789893052.221385:0:6161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c6dc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761792:192.168.202.144@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789893052.221418:0:6161:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900d3 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789893052.221430:0:6161:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3615900d3 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789893052.221496:0:6161:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c5bba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761920:192.168.202.144@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789893052.221583:0:6161:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67e03e6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789893052.222420:0:6161:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c5bba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f1325ce9-2b61-4bd9-a3a0-e7708978b358:6161:1876837985761920:192.168.202.144@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789893052.222464:0:6161:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789893052.222473:0:6161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900d3 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789893052.222483:0:6161:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff8f67c40ca000/0xbcfa502c8eff431f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3615900d3 expref: -99 pid: 6161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000080:00200008:0.0:1789893053.031751:0:63832:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1789893053.031763:0:63832:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:0.0:1789893053.031786:0:63832:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789893053.031802:0:63832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:0.0:1789893053.031814:0:63832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00000080:00200000:0.0:1789893053.031821:0:63832:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789893053.031827:0:63832:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:0.0:1789893053.031829:0:63832:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:0.0:1789893053.031836:0:63832:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f07cb8 00010000:00010000:0.0:1789893053.031839:0:63832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 33 lru_type: 1 00010000:00010000:0.0:1789893053.031846:0:63832:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200008:0.0:1789893053.032234:0:63832:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), request_mask 0, flags 0, foreign 0 00000080:00200000:0.0:1789893053.032241:0:63832:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:0.0:1789893053.032252:0:63832:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789893053.032262:0:63832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:0.0:1789893053.032273:0:63832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00000080:00200000:0.0:1789893053.032282:0:63832:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789893053.032288:0:63832:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:0.0:1789893053.032297:0:63832:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:0.0:1789893053.032302:0:63832:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f07cb8 00010000:00010000:0.0:1789893053.032307:0:63832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 34 lru_type: 1 00010000:00010000:0.0:1789893053.032316:0:63832:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:0.0:1789893053.032398:0:63832:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:0.0:1789893053.032406:0:63832:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:0.0:1789893053.032412:0:63832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:0.0:1789893053.032418:0:63832:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00000080:00200000:0.0:1789893053.032423:0:63832:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:0.0:1789893053.032426:0:63832:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:0.0:1789893053.032428:0:63832:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:0.0:1789893053.032431:0:63832:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f07bb0 00010000:00010000:0.0:1789893053.032433:0:63832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 35 lru_type: 1 00010000:00010000:0.0:1789893053.032439:0:63832:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:0.0:1789893053.032444:0:63832:0:(file.c:6650:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08), inode mode 41ed mask 44 00000080:00200008:0.0:1789893053.032449:0:63832:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), flags 300000 00000080:00200080:0.0:1789893053.032467:0:63832:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08) cmd=c0b066a2 arg=162b180 00000100:00100000:0.0:1789893053.032509:0:63832:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67c5bba300 pname:cluuid:pid:xid:nid:opc:job lfs:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:63832:1876837985762048:192.168.202.144@tcp:48:lfs.0 00000100:00100000:0.0:1789893053.032576:0:63832:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67e03e6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789893053.033858:0:63832:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67c5bba300 pname:cluuid:pid:xid:nid:opc:job lfs:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:63832:1876837985762048:192.168.202.144@tcp:48:lfs.0 00000080:00200008:0.0:1789893053.033883:0:63832:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), flags 300000 00000080:00200008:3.0:1789893053.040645:0:63834:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1789893053.040670:0:63834:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:3.0:1789893053.040686:0:63834:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1789893053.040699:0:63834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:3.0:1789893053.040709:0:63834:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00000080:00200000:3.0:1789893053.040714:0:63834:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1789893053.040719:0:63834:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:3.0:1789893053.040721:0:63834:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:3.0:1789893053.040725:0:63834:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f17cb8 00010000:00010000:3.0:1789893053.040728:0:63834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 36 lru_type: 1 00010000:00010000:3.0:1789893053.040734:0:63834:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200008:3.0:1789893053.041025:0:63834:0:(file.c:6283:ll_getattr_dentry()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), request_mask 0, flags 0, foreign 0 00000080:00200000:3.0:1789893053.041029:0:63834:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:3.0:1789893053.041035:0:63834:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1789893053.041042:0:63834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:3.0:1789893053.041052:0:63834:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00000080:00200000:3.0:1789893053.041065:0:63834:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1789893053.041070:0:63834:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:3.0:1789893053.041073:0:63834:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:3.0:1789893053.041078:0:63834:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f17cb8 00010000:00010000:3.0:1789893053.041082:0:63834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 37 lru_type: 1 00010000:00010000:3.0:1789893053.041093:0:63834:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:3.0:1789893053.041170:0:63834:0:(file.c:6178:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08),name=/ 00000002:00010000:3.0:1789893053.041178:0:63834:0:(mdc_locks.c:1506:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0 00010000:00010000:3.0:1789893053.041183:0:63834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:3.0:1789893053.041190:0:63834:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00000080:00200000:3.0:1789893053.041194:0:63834:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1 00000080:00010000:3.0:1789893053.041197:0:63834:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) 00000080:00010000:3.0:1789893053.041213:0:63834:0:(llite_internal.h:2014:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff8f67d093ec08) for lock 0xbcfa502c8eff42e7 00000080:00010000:3.0:1789893053.041216:0:63834:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0xbcfa502c8eff42e7 from it ffffa53e81f17bb0 00010000:00010000:3.0:1789893053.041219:0:63834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 38 lru_type: 1 00010000:00010000:3.0:1789893053.041225:0:63834:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff8f67c434c000 lock: ffff8f67c63e3800/0xbcfa502c8eff42e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0x412fd4b36158ff60 expref: -99 pid: 60900 timeout: 0 lvb_type: 0 lru_score: 39 lru_type: 1 00000080:00200000:3.0:1789893053.041238:0:63834:0:(file.c:6650:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08), inode mode 41ed mask 44 00000080:00200008:3.0:1789893053.041244:0:63834:0:(file.c:1090:ll_file_open()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), flags 300000 00000080:00200080:3.0:1789893053.041260:0:63834:0:(dir.c:2003:ll_dir_ioctl()) VFS Op:inode=[0x200000007:0x1:0x0](ffff8f67d093ec08) cmd=c0b066a2 arg=d4c180 00000100:00100000:3.0:1789893053.041301:0:63834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job lfs:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:63834:1876837985762176:192.168.202.144@tcp:48:lfs.0 00000100:00100000:3.0:1789893053.041367:0:63834:0:(client.c:2702:ptlrpc_set_wait()) set ffff8f67c30f7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789893053.042531:0:63834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job lfs:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:63834:1876837985762176:192.168.202.144@tcp:48:lfs.0 00000080:00200008:3.0:1789893053.042550:0:63834:0:(file.c:479:ll_file_release()) START file /:[0x200000007:0x1:0x0](ffff8f67d093ec08), flags 300000 00010000:00010000:2.0:1789893053.176294:0:43693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789893053.431364:0:56072:0:(import.c:65:import_set_state_nolock()) ffff8f67d8b58000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789893053.431367:0:2403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2403:1876837985762304:192.168.202.144@tcp:400:kworker.0 00000100:02000000:3.0:1789893053.431373:0:56072:0:(import.c:2101:ptlrpc_disconnect_and_idle_import()) lustre-OST0000-osc-ffff8f67c434c000: disconnect after 22s idle 00000100:00100000:3.0:1789893053.431413:0:2404:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2404:1876837985762432:192.168.202.144@tcp:400:kworker.0 00000100:00100000:1.0:1789893053.431430:0:2400:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2400:1876837985762688:192.168.202.144@tcp:9:kworker.0 00000100:00100000:2.0:1789893053.431476:0:2403:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8f67e0e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2403:1876837985762560:192.168.202.144@tcp:400:kworker.0 00000100:00100000:2.0:1789893053.433333:0:2403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:f1325ce9-2b61-4bd9-a3a0-e7708978b358:2403:1876837985762304:192.168.202.144@tcp:400:kworker.0 00000100:00100000:2.0:1789893053.433349:0:2403:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2403:1876837985762560:192.168.202.144@tcp:400:kworker.0 00000100:00100000:3.0:1789893053.433485:0:2404:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2404:1876837985762432:192.168.202.144@tcp:400:kworker.0 00000100:00080000:1.0:1789893053.433547:0:2400:0:(import.c:2011:ptlrpc_disconnect_idle_interpret()) @@@ inflight=1, refcount=3: rc = 0 req@ffff8f67e0e96a00 x1876837985762688/t0(0) o9->lustre-OST0000-osc-ffff8f67c434c000@192.168.202.144@tcp:28/4 lens 224/224 e 0 to 0 dl 1789893063 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789893053.433555:0:2400:0:(import.c:65:import_set_state_nolock()) ffff8f67d8b58000 lustre-OST0000_UUID: changing import state from CONNECTING to IDLE 00000100:00100000:1.0:1789893053.433558:0:2400:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8f67e0e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae9dcacf-a11d-4878-8e09-0ef4bfecbc2a:2400:1876837985762688:192.168.202.144@tcp:9:kworker.0 00000001:02000400:0.0:1789893053.497964:0:63962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_3b: @@@@@@ FAIL: Used space(24576) for user quota_usr isn't 0. Debug log: 196 lines, 196 kept, 0 dropped, 0 bad.