00000100:00100000:0.0F:1787791003.466961:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268157952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791003.467046:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1787791003.467311:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268157952 00000100:00100000:1.0:1787791003.467325:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268157952 00000100:00100000:1.0:1787791003.467398:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787791003.467410:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268157952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787791003.467453:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791003.467503:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268157952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791003.467510:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787791003.467565:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268157952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1787791003.467692:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0F:1787791003.591008:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591078:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591099:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591115:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591141:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591158:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591227:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791003.591253:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265472 00000100:00100000:2.0:1787791003.591264:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265472 00000100:00100000:2.0:1787791003.591323:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265984 00000100:00100000:2.0:1787791003.591327:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265984 00000100:00100000:2.0:1787791003.591340:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265600 00000100:00100000:2.0:1787791003.591343:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265600 00000100:00100000:2.0:1787791003.591355:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266112 00000100:00100000:2.0:1787791003.591358:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266112 00000100:00100000:2.0:1787791003.591375:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:2.0:1787791003.591385:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265472:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.591464:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265472:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 81us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.591472:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:2.0:1787791003.591490:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787791003.591497:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250265984:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.591522:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250265984:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.591528:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787791003.591540:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787791003.591554:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265600:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.591579:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265600:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.591585:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787791003.591597:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:2.0:1787791003.591604:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250266112:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.591629:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250266112:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.591635:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:2.0:1787791003.591657:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265088 00000100:00100000:2.0:1787791003.591660:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265088 00000100:00100000:2.0:1787791003.592872:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:2.0:1787791003.592890:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+13:2402:x1874634250265088:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.592933:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+13:2402:x1874634250265088:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 50us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.592940:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 167 00000100:00100000:2.0:1787791003.592982:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265216 00000100:00100000:2.0:1787791003.592988:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265216 00000100:00100000:2.0:1787791003.593019:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265728 00000100:00100000:2.0:1787791003.593022:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265728 00000100:00100000:2.0:1787791003.593035:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265344 00000100:00100000:2.0:1787791003.593038:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265344 00000100:00100000:2.0:1787791003.593050:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250265856 00000100:00100000:2.0:1787791003.593053:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250265856 00000100:00100000:2.0:1787791003.593066:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:2.0:1787791003.593072:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+22:2402:x1874634250265216:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.593116:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+22:2402:x1874634250265216:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 43us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.593123:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:2.0:1787791003.593136:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:2.0:1787791003.593142:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2402:x1874634250265728:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.593165:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2402:x1874634250265728:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (2065us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.593171:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:2.0:1787791003.593183:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787791003.593189:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265344:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.593211:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2402:x1874634250265344:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.593217:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787791003.593228:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:2.0:1787791003.593234:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250265856:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791003.593253:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2402:x1874634250265856:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 19us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.593258:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00080000:2.0:1787791003.593289:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787791003.593293:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787791003.593296:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787791003.593298:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787791003.915024:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791003.980216:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787791003.980237:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268158080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791003.980301:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791003.980356:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158080 00000100:00100000:1.0:1787791003.980362:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158080 00000100:00100000:1.0:1787791003.980414:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787791003.980422:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268158080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787791003.980456:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787791003.980494:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268158080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791003.980501:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787791003.980542:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268158080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787791003.981060:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787791003.981070:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268158208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791003.981116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791003.981150:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158208 00000100:00100000:2.0:1787791003.981153:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158208 00000100:00100000:2.0:1787791003.981175:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787791003.981180:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268158208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787791003.981197:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787791003.981226:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268158208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791003.981232:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787791003.981256:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268158208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791004.492435:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787791004.492505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.492576:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158336 00000100:00100000:2.0:1787791004.492583:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158336 00000100:00100000:2.0:1787791004.492637:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787791004.492645:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268158336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787791004.492665:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0F:1787791004.493077:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268158592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787791004.493123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.496426:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268158336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3770us (3910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.496442:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787791004.496475:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158592 00000100:00100000:2.0:1787791004.496484:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158592 00000100:00100000:2.0:1787791004.496532:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787791004.496541:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268158592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787791004.496576:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787791004.496661:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe64b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268158592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.496668:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787791004.496725:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787791004.496737:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791004.496828:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268158592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787791004.500785:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268159104:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.502507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.502554:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268159616:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.502579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.502605:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787791004.502613:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268158720:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.502642:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.502679:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268159232:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.502721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.502763:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268159744:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.502786:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.503164:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159104 00000100:00100000:2.0:1787791004.503173:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159104 00000100:00100000:2.0:1787791004.503966:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159616 00000100:00100000:2.0:1787791004.503973:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159616 00000100:00100000:2.0:1787791004.504013:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159744 00000100:00100000:2.0:1787791004.504016:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159744 00000100:00100000:2.0:1787791004.504297:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787791004.504308:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268159104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.504486:0:3638:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1787791004.504493:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9170e4d58f00, transno 8589934596 00000004:00080000:1.0:1787791004.504506:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1787791004.504551:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268158336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787791004.504581:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159232 00000100:00100000:1.0:1787791004.504585:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159232 00000100:00100000:1.0:1787791004.504614:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787791004.504620:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268159232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.504664:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268159232:12345-0@lo:400:kworker.0 Request processed in 43us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.504671:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787791004.504717:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268158464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787791004.504761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791004.504783:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268158976:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.504963:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268159104:12345-0@lo:400:kworker.0 Request processed in 657us (2458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.504970:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787791004.504985:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787791004.504992:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268159616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.505021:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268159616:12345-0@lo:400:kworker.0 Request processed in 31us (2442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.505250:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787791004.505263:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787791004.505269:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268159744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.505298:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268159744:12345-0@lo:400:kworker.0 Request processed in 31us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.505303:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787791004.505322:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787791004.505327:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787791004.505785:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158720 00000100:00100000:1.0:1787791004.505955:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791004.505983:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268159488:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.506005:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791004.506021:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268160000:0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.506135:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158720 00000100:00100000:2.0:1787791004.506173:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787791004.506265:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791004.506306:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159488 00000100:00100000:1.0:1787791004.506310:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159488 00000100:00100000:1.0:1787791004.506336:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160000 00000100:00100000:1.0:1787791004.506340:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160000 00000100:00100000:1.0:1787791004.506365:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787791004.506445:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3640:x1874634268158720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.506482:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3640:x1874634268158720:12345-0@lo:400:kworker.0 Request processed in 40us (3840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.506488:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787791004.506784:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268159488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.507169:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268159488:12345-0@lo:400:kworker.0 Request processed in 387us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.507246:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787791004.507271:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787791004.507293:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268160000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.507325:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268160000:12345-0@lo:400:kworker.0 Request processed in 35us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.507331:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787791004.507561:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268159488:0@lo:400:kworker.0 00010000:00080000:2.0:1787791004.507576:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d5680 x1874634268160000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791004.507586:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268160000:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.507975:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268158720:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.507988:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268159232:0@lo:400:kworker.0 00010000:00080000:1.0:1787791004.508001:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc38d7c00 x1874634268159744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791004.508010:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268159744:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508021:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268159104:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508046:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268159616:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508074:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158464 00000100:00100000:1.0:1787791004.508078:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158464 00000100:00100000:1.0:1787791004.508110:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791004.508115:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268158464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787791004.508131:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787791004.508172:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268158464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.508477:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791004.508499:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158976 00000100:00100000:1.0:1787791004.508502:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158976 00000100:00100000:1.0:1787791004.508525:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791004.508531:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268158976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508559:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268158976:12345-0@lo:400:kworker.0 Request processed in 29us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.508573:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787791004.508598:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787791004.508603:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787791004.508630:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268158464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787791004.508639:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268158976:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508670:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268158848:0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.508716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791004.508759:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268158848 00000100:00100000:1.0:1787791004.508763:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268158848 00000100:00100000:1.0:1787791004.508787:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787791004.509309:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268158848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.509349:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268158848:12345-0@lo:400:kworker.0 Request processed in 44us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.509355:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787791004.509390:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268158848:0@lo:400:kworker.0 00000100:00100000:0.0:1787791004.509398:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268159360:0@lo:400:kworker.0 00000100:00100000:0.0:1787791004.509427:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791004.509459:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268159872:0@lo:400:kworker.0 00000100:00100000:0.0:1787791004.509484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791004.509569:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159360 00000100:00100000:2.0:1787791004.509574:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159360 00000100:00100000:1.0:1787791004.509627:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268159872 00000100:00100000:1.0:1787791004.509631:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268159872 00000100:00100000:1.0:1787791004.509687:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787791004.509693:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268159872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791004.509758:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268159872:12345-0@lo:400:kworker.0 Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791004.509763:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787791004.509863:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787791004.509929:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787791004.509936:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268159360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791004.509970:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268159360:12345-0@lo:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791004.509988:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787791004.510091:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268159360:0@lo:400:kworker.0 00000100:00100000:0.0:1787791004.510100:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268159872:0@lo:400:kworker.0 00000001:00080000:0.0:1787791004.511812:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1787791004.511830:0:17114:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9170c34b5cc0 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1787791004.511836:0:17114:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170ce8c0500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9170c34b5a80 00000020:00080000:0.0:1787791004.511839:0:17114:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9170ce8c0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff916fc33a2600 00010000:00010000:1.0:1787791004.511973:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791004.511985:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791004.512013:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787791004.512019:0:17174:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:1.0:1787791004.512021:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791004.512030:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791004.512042:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791004.512061:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:1.0:1787791004.512065:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787791004.512070:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791004.512077:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165f200/0xcf9477fddcf1f2fb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17135 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787791004.512120:0:17174:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787791004.943616:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791005.722283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791005.722398:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266240 00000100:00100000:1.0:1787791005.722409:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266240 00000100:00100000:1.0:1787791005.722496:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:1.0:1787791005.722507:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+13:15571:x1874634250266240:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787791005.722615:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+13:15571:x1874634250266240:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 109us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791005.722623:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00080000:3.0:1787791005.722691:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787791005.741438:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791005.741542:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266368 00000100:00100000:3.0:1787791005.741552:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266368 00000100:00100000:3.0:1787791005.741640:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:3.0:1787791005.741652:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15571:x1874634250266368:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787791005.741808:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:15571:x1874634250266368:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 159us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791005.741816:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00080000:1.0:1787791005.742248:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787791005.747853:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791005.748003:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266624 00000100:00100000:1.0:1787791005.748015:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266624 00000100:00100000:1.0:1787791005.748090:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787791005.748100:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+13:15571:x1874634250266624:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787791005.748329:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+14:15571:x1874634250266624:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 230us (489us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1787791005.748337:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000040:00080000:1.0:1787791005.771369:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787791005.771380:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787791005.771401:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787791005.771410:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787791005.963338:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791006.987794:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791008.011008:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791008.587007:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268160128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791008.587079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791008.591523:0:18644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160128 00000100:00100000:3.0:1787791008.591538:0:18644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160128 00000100:00080000:1.0:1787791008.591877:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791008.592031:0:18644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787791008.592045:0:18644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268160128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787791008.592211:0:18644:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787791008.595223:0:18644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268160128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3173us (8132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791008.595239:0:18644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787791008.597823:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268160128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787791008.720826:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.720874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.720904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791008.720921:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266752 00000100:00100000:2.0:1787791008.720932:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266752 00000100:00100000:1.0:1787791008.720937:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.720965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.720986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791008.720992:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 169 00000100:00100000:2.0:1787791008.721004:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250266752:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791008.721073:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250266752:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791008.721082:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 169 00000100:00100000:2.0:1787791008.721121:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267136 00000100:00100000:2.0:1787791008.721124:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267136 00000100:00100000:2.0:1787791008.721237:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787791008.721250:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250267136:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791008.721252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791008.721298:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250267136:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 53us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791008.721304:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787791008.721315:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267264 00000100:00100000:2.0:1787791008.721319:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267264 00000100:00100000:2.0:1787791008.721348:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:2.0:1787791008.721355:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2399:x1874634250267264:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:2.0:1787791008.721389:0:18643:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f031 00000100:00080000:2.0:1787791008.721409:0:18643:0:(import.c:65:import_set_state_nolock()) ffff9170ceb1c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787791008.721459:0:18643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787791008.724447:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267008 00000100:00100000:3.0:1787791008.724462:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250266880 00000100:00100000:0.0:1787791008.724463:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267008 00000100:00100000:3.0:1787791008.724479:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250266880 00000100:00100000:3.0:1787791008.724576:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267392 00000100:00100000:3.0:1787791008.724581:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267392 00000100:00100000:0.0:1787791008.724869:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267520 00000100:00100000:0.0:1787791008.724876:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267520 00000100:00100000:0.0:1787791008.724910:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 72 00000100:00100000:0.0:1787791008.724922:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+14:2401:x1874634250266880:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791008.725044:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.725217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791008.725251:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 73 00000100:00100000:1.0:1787791008.725261:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250267008:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791008.725312:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2401:x1874634250267008:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 53us (4437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791008.725320:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 73 00000100:00100000:1.0:1787791008.725353:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 74 00000100:00100000:1.0:1787791008.725360:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:2401:x1874634250267392:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791008.725388:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+6:2401:x1874634250267392:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 28us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791008.725411:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 74 00000100:00100000:1.0:1787791008.725425:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:1.0:1787791008.725431:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250267520:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791008.725457:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250267520:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (4470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791008.725463:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 75 00000100:00100000:1.0:1787791008.725482:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267648 00000100:00100000:1.0:1787791008.725486:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267648 00000100:00100000:1.0:1787791008.725505:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250267776 00000100:00100000:1.0:1787791008.725508:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250267776 00000100:00100000:1.0:1787791008.725523:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:1.0:1787791008.725529:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2399:x1874634250267648:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:1.0:1787791008.725547:0:18640:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f069 00000100:00080000:1.0:1787791008.725562:0:18640:0:(import.c:65:import_set_state_nolock()) ffff9170c3530000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791008.725601:0:18640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787791008.726371:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+2:2399:x1874634250267648:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 838us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791008.726380:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:1.0:1787791008.726399:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:1.0:1787791008.726407:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2399:x1874634250267776:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:1.0:1787791008.726422:0:18640:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f070 00000100:00080000:1.0:1787791008.726451:0:18640:0:(import.c:65:import_set_state_nolock()) ffff9170f39e1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791008.726504:0:18640:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787791008.726538:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+2:2399:x1874634250267264:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 5180us (5287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791008.726549:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:1.0:1787791008.726616:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3648b1be-585a-40cf-a928-57e0e7a37168+2:2399:x1874634250267776:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 210us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791008.726624:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00080000:1.0:1787791008.726652:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787791008.726657:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787791008.726660:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787791008.726662:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787791008.726670:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791008.726676:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791008.726681:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791008.727561:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+14:2401:x1874634250266880:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 2634us (6649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791008.727573:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 72 00010000:00010000:1.0:1787791009.035448:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791009.099049:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268160256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791009.099126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791009.099233:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160256 00000100:00100000:0.0:1787791009.099241:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160256 00000100:00100000:0.0:1787791009.099296:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787791009.099305:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268160256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787791009.099338:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791009.099387:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268160256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791009.099394:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787791009.099435:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268160256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791009.100415:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787791009.100428:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268160384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791009.100470:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791009.100566:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160384 00000100:00100000:2.0:1787791009.100571:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160384 00000100:00100000:2.0:1787791009.100610:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787791009.100621:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268160384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787791009.100643:0:17140:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1787791009.100701:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268160384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791009.100729:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787791009.100804:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268160384:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1787791009.501102:0:20511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 20:36:49 (1787791009) 00000100:00100000:1.0:1787791009.610906:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268160512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787791009.610997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.611065:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160512 00000100:00100000:1.0:1787791009.611073:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160512 00000100:00100000:1.0:1787791009.611134:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787791009.611145:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268160512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787791009.611175:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787791009.611221:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268160512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.611236:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787791009.611262:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787791009.611301:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268160512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787791009.611481:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268160640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787791009.611512:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.611579:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160640 00000100:00100000:1.0:1787791009.611584:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160640 00000100:00100000:1.0:1787791009.611624:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791009.611631:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268160640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787791009.611642:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791009.611677:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268160640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.611695:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787791009.611797:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268160768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787791009.611828:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787791009.611886:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787791009.614549:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160768 00000100:00100000:1.0:1787791009.614576:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160768 00000100:00100000:1.0:1787791009.614644:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787791009.614653:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268160768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787791009.614677:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787791009.614788:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268160768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.614794:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787791009.614851:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268160640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787791009.614951:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268160896:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615044:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791009.615052:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268161024:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615123:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268161408:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615150:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615167:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791009.615173:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615218:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268160896 00000100:00100000:1.0:1787791009.615222:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268160896 00000100:00100000:1.0:1787791009.615264:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787791009.615270:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615305:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268160896:12345-0@lo:400:kworker.0 Request processed in 35us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.615311:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787791009.615338:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161024 00000100:00100000:1.0:1787791009.615341:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161024 00000100:00100000:1.0:1787791009.615367:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161408 00000100:00100000:1.0:1787791009.615369:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161408 00000100:00100000:1.0:1787791009.615388:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161536 00000100:00100000:1.0:1787791009.615391:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161536 00000100:00100000:1.0:1787791009.615407:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787791009.615414:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615445:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268161024:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.615451:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787791009.615463:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787791009.615468:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268161408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615494:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268161408:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.615510:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787791009.615524:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787791009.615530:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268161536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615561:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268161536:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.615567:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787791009.615599:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268161152:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615648:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268161664:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615673:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615737:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787791009.615747:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268161280:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615773:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615789:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268161792:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791009.615832:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161152 00000100:00100000:1.0:1787791009.615836:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161152 00000100:00100000:1.0:1787791009.615866:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791009.615873:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268161152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.615911:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268161152:12345-0@lo:400:kworker.0 Request processed in 40us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.615917:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791009.615937:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161664 00000100:00100000:1.0:1787791009.615940:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161664 00000100:00100000:1.0:1787791009.615964:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161280 00000100:00100000:1.0:1787791009.615974:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161280 00000100:00100000:1.0:1787791009.615989:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161792 00000100:00100000:1.0:1787791009.615991:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161792 00000100:00100000:1.0:1787791009.616006:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787791009.616012:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268161664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616043:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268161664:12345-0@lo:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.616050:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787791009.616066:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787791009.616073:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268161280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616103:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268161280:12345-0@lo:400:kworker.0 Request processed in 32us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.616109:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787791009.616122:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787791009.616129:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268161792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616157:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4545e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268161792:12345-0@lo:400:kworker.0 Request processed in 30us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791009.616163:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:1.0:1787791009.616208:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe65e00 x1874634268161536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791009.616221:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268161536:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268161408:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616245:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268161024:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616253:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268160896:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616300:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268161280:0@lo:400:kworker.0 00010000:00080000:1.0:1787791009.616312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170fbe64780 x1874634268161792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791009.616321:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268161792:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616333:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268161152:0@lo:400:kworker.0 00000100:00100000:1.0:1787791009.616345:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268161664:0@lo:400:kworker.0 00000100:00100000:0.0:1787791009.616370:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268160768:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787791009.616594:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787791009.616599:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787791009.616603:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1787791009.998336:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787791010.060590:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787791010.139942:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787791010.139961:0:17114:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1787791010.139995:0:17174:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1787791010.140009:0:17174:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:1.0:1787791011.082924:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791012.107024:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791013.131020:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791013.208329:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791013.208434:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250268032 00000100:00100000:3.0:1787791013.208444:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250268032 00000100:00100000:3.0:1787791013.208573:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787791013.208585:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+13:16334:x1874634250268032:12345-192.168.202.22@tcp:35:umount.0 00000001:00080000:3.0:1787791013.208899:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1787791013.208990:0:17138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:3.0:1787791013.209617:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:16334:x1874634250268032:12345-192.168.202.22@tcp:35:umount.0 Request processed in 1030us (1294us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1787791013.209629:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000020:00080000:3.0:1787791013.209634:0:17138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1787791013.210997:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787791013.214841:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791013.214886:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791013.215098:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250268160 00000100:00100000:0.0:1787791013.215108:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250268160 00000100:00100000:0.0:1787791013.215318:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250268416 00000100:00100000:0.0:1787791013.215322:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250268416 00000100:00100000:0.0:1787791013.215343:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:0.0:1787791013.215355:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:915f61f1-8646-45de-ac4c-9339109974cf+14:2401:x1874634250268160:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787791013.215372:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791013.215396:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f64 expref: 14 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791013.215415:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791013.215471:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:915f61f1-8646-45de-ac4c-9339109974cf+13:2401:x1874634250268160:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 118us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791013.215493:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:0.0:1787791013.215511:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787791013.215517:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:915f61f1-8646-45de-ac4c-9339109974cf+12:2401:x1874634250268416:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787791013.215524:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791013.215532:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f093 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722404b expref: 12 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791013.215541:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791013.215556:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:915f61f1-8646-45de-ac4c-9339109974cf+11:2401:x1874634250268416:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 40us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791013.215562:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787791013.215896:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791013.216001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791013.216283:0:18642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250268544 00000100:00100000:1.0:1787791013.216289:0:18642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250268544 00000100:00100000:1.0:1787791013.216343:0:18642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:1.0:1787791013.216351:0:18642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2399:x1874634250268544:12345-192.168.202.22@tcp:9:umount.0 00000020:00000080:1.0:1787791013.216381:0:18642:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f02a 00000100:00080000:1.0:1787791013.216391:0:18642:0:(import.c:65:import_set_state_nolock()) ffff916fc46ec000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791013.216431:0:18642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787791013.216543:0:18642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+2:2399:x1874634250268544:12345-192.168.202.22@tcp:9:umount.0 Request processed in 192us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791013.216549:0:18642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00010000:00010000:1.0:1787791013.216570:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791013.216984:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787791013.218599:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250268288 00000100:00100000:0.0:1787791013.218612:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250268288 00000100:00100000:0.0:1787791013.218687:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:0.0:1787791013.218700:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+11:2401:x1874634250268288:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787791013.218764:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791013.218787:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539c00/0xcf9477fddcf1f00e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f95 expref: 11 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791013.218805:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791013.218870:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+10:2401:x1874634250268288:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 173us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791013.218878:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:2.0:1787791013.227182:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791013.227520:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250269440 00000100:00100000:1.0:1787791013.227550:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250269440 00000100:00100000:1.0:1787791013.227672:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:1.0:1787791013.227684:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+16:2399:x1874634250269440:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787791013.227773:0:19928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f01c 00000020:00010000:1.0:1787791013.227804:0:19928:0:(genops.c:1921:obd_stale_export_put()) Put export ffff916fc46ea800: total 0 00000100:00080000:1.0:1787791013.227810:0:19928:0:(import.c:65:import_set_state_nolock()) ffff916fc46ed800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791013.227847:0:19928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1787791013.228087:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+15:2399:x1874634250269440:12345-192.168.202.22@tcp:39:umount.0 Request processed in 405us (920us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1787791013.228097:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00000020:00010000:3.0:1787791013.228167:0:17123:0:(genops.c:1907:obd_stale_export_get()) Get export ffff916fc46ea800: total 0 00010000:00010000:3.0:1787791013.228173:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791013.228234:0:17123:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff916fc46ea800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787791013.228279:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170e4e86000) 00010000:00010000:3.0:1787791013.228283:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787791013.228305:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5400/0xcf9477fddcf1f0e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224052 expref: 14 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228338:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9170e4e86b00) 00010000:00010000:3.0:1787791013.228341:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787791013.228346:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5c00/0xcf9477fddcf1f2d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240e5 expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228365:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff916fc2686d00) 00010000:00010000:3.0:1787791013.228368:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787791013.228372:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d5600/0xcf9477fddcf1f1c7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224091 expref: 12 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228390:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787791013.228392:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787791013.228397:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fb800/0xcf9477fddcf1f276 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240d0 expref: 11 pid: 18527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228430:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787791013.228433:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787791013.228437:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fbc00/0xcf9477fddcf1f245 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272240bb expref: 10 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228452:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:3.0:1787791013.228454:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787791013.228458:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc26fae00/0xcf9477fddcf1f142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224067 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228472:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff916fc2686b00) 00010000:00010000:3.0:1787791013.228474:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787791013.228478:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f32c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224108 expref: 8 pid: 19928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228494:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9170e4e86200) 00010000:00010000:3.0:1787791013.228497:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787791013.228501:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d4600/0xcf9477fddcf1f103 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224059 expref: 7 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791013.228514:0:17123:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff916fc46ea800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787791013.228528:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791013.228530:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791013.228532:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791013.235472:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791013.235543:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250269568 00000100:00100000:1.0:1787791013.235555:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250269568 00000100:00100000:1.0:1787791013.235633:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:1.0:1787791013.235642:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+5:2399:x1874634250269568:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787791013.235698:0:17136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f023 00000100:00080000:2.0:1787791013.236250:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787791013.236311:0:17136:0:(import.c:65:import_set_state_nolock()) ffff916fc46eb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791013.236387:0:17136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1787791013.236749:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32+3:2399:x1874634250269568:12345-192.168.202.22@tcp:39:umount.0 Request processed in 1104us (1287us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787791013.236761:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00010000:00010000:2.0:1787791013.238496:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791013.707238:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268161920:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791013.707334:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791013.707528:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268161920 00000100:00100000:1.0:1787791013.707538:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268161920 00000100:00100000:1.0:1787791013.707622:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787791013.707634:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268161920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787791013.707681:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791013.707769:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268161920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791013.707807:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787791013.707973:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787791013.708140:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268161920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791013.830418:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791013.830475:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791013.830639:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250269696 00000100:00100000:2.0:1787791013.830662:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250269696 00000100:00100000:2.0:1787791013.830780:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250269824 00000100:00100000:2.0:1787791013.830783:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250269824 00000100:00100000:2.0:1787791013.830818:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:2.0:1787791013.830829:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2400:x1874634250269696:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791013.830934:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+6:2400:x1874634250269696:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 107us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791013.830942:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 82 00000100:00100000:2.0:1787791013.830974:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 83 00000100:00100000:2.0:1787791013.830981:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250269824:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791013.831007:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3648b1be-585a-40cf-a928-57e0e7a37168+5:2400:x1874634250269824:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791013.831013:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 83 00000100:00080000:3.0:1787791013.831191:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787791013.831196:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787791014.155175:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791014.220171:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268162048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791014.220355:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268162176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791014.220358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791014.220787:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162048 00000100:00100000:2.0:1787791014.220797:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162048 00000100:00100000:2.0:1787791014.220868:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787791014.220880:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268162048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787791014.220926:0:18216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787791014.221094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791014.221690:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162176 00000100:00100000:1.0:1787791014.221698:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162176 00000100:00100000:1.0:1787791014.221765:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787791014.221775:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268162176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787791014.221811:0:17139:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787791014.221871:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268162176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791014.221879:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787791014.222271:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268162176:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1787791014.223402:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000020:00000080:0.0:1787791014.223411:0:18637:0:(genops.c:885:class_export_put()) final put ffff916fc46e9000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00100000:0.0:1787791014.223432:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000020:00000080:0.0:1787791014.223436:0:18637:0:(genops.c:885:class_export_put()) final put ffff9170c3536000/3648b1be-585a-40cf-a928-57e0e7a37168 00000020:00000080:1.0:1787791014.224001:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e9000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 for lustre-OST0000 00000020:00000080:1.0:1787791014.224122:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c3536000/3648b1be-585a-40cf-a928-57e0e7a37168 for lustre-OST0000 00000020:00000080:1.0:1787791014.224150:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46ec000 for lustre-OST0000 00000020:00000080:1.0:1787791014.224157:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170c3530000 for lustre-OST0000 00000100:00100000:2.0:1787791014.227944:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268162048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7031us (7550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791014.227963:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787791014.228005:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268162048:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1787791014.229310:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000020:00000080:0.0:1787791014.229317:0:19455:0:(genops.c:885:class_export_put()) final put ffff9170c3533800/3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:0.0:1787791014.229390:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000020:00000080:0.0:1787791014.229393:0:19455:0:(genops.c:885:class_export_put()) final put ffff916fc46eb000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000020:00000080:3.0:1787791014.231189:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c3533800/3648b1be-585a-40cf-a928-57e0e7a37168 for lustre-OST0001 00000020:00000080:3.0:1787791014.231263:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f39e1800 for lustre-OST0001 00000020:00000080:3.0:1787791014.235935:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46eb000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 for lustre-OST0001 00000020:00000080:3.0:1787791014.235999:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ceb1c000 for lustre-OST0001 00000100:00100000:0.0:1787791014.558868:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791014.558923:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791014.558962:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791014.559129:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250269952 00000100:00100000:3.0:1787791014.559144:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250269952 00000100:00100000:3.0:1787791014.559219:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270208 00000100:00100000:3.0:1787791014.559223:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270208 00000100:00100000:3.0:1787791014.559245:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270080 00000100:00100000:3.0:1787791014.559248:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270080 00000100:00100000:3.0:1787791014.559357:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787791014.559375:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+12:2400:x1874634250269952:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791014.559396:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791014.559425:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2200/0xcf9477fddcf1f046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223fd4 expref: 12 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791014.559449:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791014.559525:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+11:2400:x1874634250269952:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 155us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791014.565240:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787791014.565499:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787791014.565519:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+10:2400:x1874634250270208:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791014.565553:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791014.565587:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f08c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224044 expref: 10 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791014.565627:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791014.569048:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+9:2400:x1874634250270208:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 3518us (10102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791014.569072:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787791014.577798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791014.577892:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787791014.577915:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+8:2400:x1874634250270080:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787791014.577944:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787791014.577975:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f04d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224005 expref: 8 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791014.577999:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787791014.578063:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:915f61f1-8646-45de-ac4c-9339109974cf+7:2400:x1874634250270080:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 159us (19099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791014.578072:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787791014.579025:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270464 00000100:00100000:1.0:1787791014.579041:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270464 00000100:00100000:1.0:1787791014.579114:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:1.0:1787791014.579124:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+6:2399:x1874634250270464:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:1.0:1787791014.579176:0:17136:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f05b 00000020:00010000:1.0:1787791014.579188:0:17136:0:(genops.c:1921:obd_stale_export_put()) Put export ffff916fc1dd3000: total 0 00000100:00080000:1.0:1787791014.579194:0:17136:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787791014.579235:0:17136:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:3.0:1787791014.579419:0:17123:0:(genops.c:1907:obd_stale_export_get()) Get export ffff916fc1dd3000: total 0 00010000:00010000:3.0:1787791014.579537:0:17123:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff916fc1dd3000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787791014.579588:0:17123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2686700) 00010000:00010000:3.0:1787791014.579592:0:17123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787791014.579602:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170c165ec00/0xcf9477fddcf1f150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722406e expref: 5 pid: 17134 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791014.579633:0:17123:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff916fc1dd3000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787791014.579657:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791014.579661:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791014.579663:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791014.579863:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3648b1be-585a-40cf-a928-57e0e7a37168+3:2399:x1874634250270464:12345-192.168.202.22@tcp:39:umount.0 Request processed in 726us (2076us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787791014.579879:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:2.0:1787791014.591722:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791014.591863:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270592 00000100:00100000:3.0:1787791014.591880:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270592 00000100:00100000:3.0:1787791014.591950:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:3.0:1787791014.591962:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3648b1be-585a-40cf-a928-57e0e7a37168+5:2399:x1874634250270592:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:3.0:1787791014.592008:0:17134:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1f062 00000100:00080000:3.0:1787791014.592020:0:17134:0:(import.c:65:import_set_state_nolock()) ffff9170f3de0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787791014.592051:0:17134:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:2.0:1787791014.592121:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791014.592214:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3648b1be-585a-40cf-a928-57e0e7a37168+3:2399:x1874634250270592:12345-192.168.202.22@tcp:39:umount.0 Request processed in 253us (526us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787791014.592223:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:0.0:1787791014.627835:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791014.627963:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270848 00000100:00100000:2.0:1787791014.627980:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270848 00000100:00100000:1.0:1787791014.628122:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 171 00000100:00100000:1.0:1787791014.628155:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+7:2399:x1874634250270848:12345-192.168.202.22@tcp:251:umount.0 00000020:00000080:1.0:1787791014.628210:0:17127:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eff9 00000020:00010000:1.0:1787791014.628220:0:17127:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9170f3de2800: total 0 00000100:00080000:1.0:1787791014.628225:0:17127:0:(import.c:65:import_set_state_nolock()) ffff916fc36b0800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1787791014.628274:0:17122:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9170f3de2800: total 0 00000100:00100000:1.0:1787791014.628307:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:915f61f1-8646-45de-ac4c-9339109974cf+3:2399:x1874634250270848:12345-192.168.202.22@tcp:251:umount.0 Request processed in 158us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791014.628322:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 171 00010000:00010000:2.0:1787791014.628346:0:17122:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9170f3de2800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787791014.628385:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4538200/0xcf9477fddcf1f000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927223f5d expref: 2 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791014.628401:0:17122:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9170f3de2800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787791014.628412:0:17122:0:(genops.c:885:class_export_put()) final put ffff9170f3de2800/915f61f1-8646-45de-ac4c-9339109974cf 00010000:00010000:2.0:1787791014.628428:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791014.628431:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791014.628432:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787791014.628836:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3de2800/915f61f1-8646-45de-ac4c-9339109974cf for MGS 00000020:00000080:1.0:1787791014.630854:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc36b0800 for MGS 00000100:00100000:2.0:1787791014.731097:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268162688:0@lo:400:kworker.0 00000100:00100000:2.0:1787791014.731172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.731195:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787791014.731214:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268163328:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791014.731252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.731263:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268162816:0@lo:400:kworker.0 00000100:00100000:2.0:1787791014.731281:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268163712:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731294:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791014.731315:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.731320:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268163200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787791014.731351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791014.731364:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162688 00000100:00100000:2.0:1787791014.731373:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162688 00000100:00100000:0.0:1787791014.731374:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731422:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791014.731436:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787791014.731447:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268162688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731472:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162304 00000100:00100000:0.0:1787791014.731477:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162304 00000100:00100000:2.0:1787791014.731501:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268162688:12345-0@lo:400:kworker.0 Request processed in 56us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.731501:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163200 00000100:00100000:0.0:1787791014.731506:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163200 00000100:00100000:2.0:1787791014.731514:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787791014.731531:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791014.731542:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268162304:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787791014.731544:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163328 00000100:00100000:2.0:1787791014.731549:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163328 00000100:00100000:2.0:1787791014.731572:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162816 00000100:00100000:2.0:1787791014.731575:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162816 00002000:00000024:0.0:1787791014.731578:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791014.731617:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.731622:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791014.731634:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787791014.731653:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268163200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787791014.731664:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787791014.731669:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163712 00000100:00100000:2.0:1787791014.731675:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163712 00000100:00100000:2.0:1787791014.731701:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163840 00000100:00100000:0.0:1787791014.731726:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268163200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791014.731735:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163840 00000100:00100000:0.0:1787791014.731735:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787791014.731762:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787791014.731770:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268163328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791014.731805:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268163328:12345-0@lo:400:kworker.0 Request processed in 36us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.731870:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787791014.731879:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268162816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731912:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268162816:12345-0@lo:400:kworker.0 Request processed in 35us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.731918:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787791014.731933:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787791014.731939:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268163712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.731967:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268163712:12345-0@lo:400:kworker.0 Request processed in 28us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.731982:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787791014.731995:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787791014.732001:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268163840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732028:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268163840:12345-0@lo:400:kworker.0 Request processed in 28us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.732034:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787791014.732078:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4544f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791014.732089:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268162816:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732099:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268163200:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787791014.732111:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5ada40 x1874634268163840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791014.732120:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268163840:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732149:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268162432:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732212:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268162944:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732254:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732292:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268163968:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787791014.732312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732330:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787791014.732336:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732365:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732383:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268163072:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732402:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732419:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732440:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791014.732461:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162432 00000100:00100000:0.0:1787791014.732464:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162432 00000100:00100000:0.0:1787791014.732492:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787791014.732498:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268162432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732529:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e0c65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3638:x1874634268162432:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.732534:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787791014.732559:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162944 00000100:00100000:0.0:1787791014.732562:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162944 00000100:00100000:0.0:1787791014.732582:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268162560 00000100:00100000:0.0:1787791014.732584:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268162560 00000100:00100000:0.0:1787791014.732598:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163072 00000100:00100000:0.0:1787791014.732600:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163072 00000100:00100000:0.0:1787791014.732614:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787791014.732619:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732854:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268162944:12345-0@lo:400:kworker.0 Request processed in 233us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.732861:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787791014.732874:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791014.732880:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732909:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268162560:12345-0@lo:400:kworker.0 Request processed in 29us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.732921:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791014.732933:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787791014.732938:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.732966:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4544f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268163072:12345-0@lo:400:kworker.0 Request processed in 28us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.732972:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787791014.732989:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163456 00000100:00100000:0.0:1787791014.732993:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163456 00000100:00100000:0.0:1787791014.733011:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163584 00000100:00100000:0.0:1787791014.733015:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163584 00000100:00100000:2.0:1787791014.733029:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787791014.733048:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787791014.733054:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268163456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791014.733091:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268163456:12345-0@lo:400:kworker.0 Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791014.733097:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787791014.733108:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787791014.733113:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268163584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733131:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268163968 00000100:00100000:0.0:1787791014.733136:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268163968 00000100:00100000:2.0:1787791014.733139:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268163584:12345-0@lo:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791014.733146:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787791014.733181:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787791014.733191:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268163968:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787791014.733193:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268162688:0@lo:400:kworker.0 00002000:00000024:0.0:1787791014.733206:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787791014.733210:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268163328:0@lo:400:kworker.0 00000100:00100000:2.0:1787791014.733225:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268163712:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733250:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268163968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791014.733260:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787791014.733296:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268162560:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733306:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268163072:0@lo:400:kworker.0 00010000:00080000:0.0:1787791014.733328:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d4b40 x1874634268163584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791014.733338:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268163584:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733349:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268162432:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733370:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268162944:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733380:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268163456:0@lo:400:kworker.0 00000100:00100000:0.0:1787791014.733394:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268163968:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787791014.736027:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787791014.736066:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787791014.736082:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787791014.736087:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787791015.180919:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791016.011356:0:17168:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787791016.011366:0:17168:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787791016.011388:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787791016.011396:0:17168:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787791016.203151:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787791016.526649:0:20706:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787791016.542355:0:20706:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787791016.542407:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.542421:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.542428:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.542435:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.543182:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787791016.543201:0:20706:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787791016.543230:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791016.543234:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787791016.543240:0:20706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787791016.543275:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787791016.549847:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268164096:0@lo:39:umount.0 00000100:00100000:0.0:1787791016.549930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791016.550211:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164096 00000100:00100000:3.0:1787791016.550222:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164096 00000100:00100000:3.0:1787791016.550481:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787791016.550493:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874634268164096:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787791016.550525:0:17134:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ebed 00000100:00080000:3.0:1787791016.550535:0:17134:0:(import.c:65:import_set_state_nolock()) ffff9170d6148800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787791016.550599:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791016.550609:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.550629:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791016.550635:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.550645:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791016.550652:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791016.550658:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787791016.550661:0:17122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787791016.550677:0:17122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787791016.550941:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.550949:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791016.550975:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.550983:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4538800/0xcf9477fddcf1ebbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ebc3 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.550998:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791016.551000:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791016.551002:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791016.552397:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791016.552471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791016.552926:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164224 00000100:00100000:0.0:1787791016.552935:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164224 00000100:00100000:0.0:1787791016.552987:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787791016.552994:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+24:3639:x1874634268164224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791016.553008:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791016.553027:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fba00/0xcf9477fddcf1ebc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ebbc expref: 24 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.553057:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791016.553177:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:3639:x1874634268164224:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791016.553184:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787791016.553227:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5af840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164224:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787791016.555167:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791016.555661:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1874634268164096:12345-0@lo:39:umount.0 Request processed in 5167us (5727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791016.555673:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1787791016.555686:0:17134:0:(genops.c:885:class_export_put()) final put ffff9170d614a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787791016.555962:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d614a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787791016.556033:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d6148800 for lustre-MDT0000 00000100:00080000:2.0:1787791016.556440:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ce83e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787791016.556461:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268164096:0@lo:39:umount.0 00000100:00080000:0.0:1787791016.556555:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787791016.556560:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787791016.556564:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787791016.558362:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558379:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558386:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558392:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558454:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791016.558461:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558468:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558473:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.558479:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558549:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787791016.558556:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558563:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787791016.558567:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558575:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787791016.558583:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791016.558589:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787791016.558591:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787791016.558637:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558644:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787791016.558680:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558735:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4200/0xcf9477fddcf1eb0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb14 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558752:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791016.558756:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558761:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787791016.558774:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558782:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787791016.558788:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791016.558793:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787791016.558795:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787791016.558809:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558814:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787791016.558821:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.558827:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791016.558829:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791016.558831:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791016.558957:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268164352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791016.559031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791016.559084:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787791016.559089:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268164480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787791016.559174:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164352 00000100:00100000:2.0:1787791016.559181:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164352 00000100:00100000:2.0:1787791016.559232:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787791016.559240:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+23:3640:x1874634268164352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787791016.559254:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787791016.559279:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995e00/0xcf9477fddcf1eb14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1eb0d expref: 23 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.559293:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787791016.559325:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:3640:x1874634268164352:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791016.559331:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787791016.559506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791016.559544:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc38d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268164352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787791016.559802:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164480 00000100:00100000:2.0:1787791016.559807:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164480 00000100:00100000:2.0:1787791016.559833:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787791016.559839:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+22:3640:x1874634268164480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787791016.559847:0:17119:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787791016.559856:0:17119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad5c00/0xcf9477fddcf1ee5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ee55 expref: 22 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.559867:0:17119:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787791016.559906:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3640:x1874634268164480:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791016.559912:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791016.560041:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268164480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791016.560389:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791016.560397:0:20706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4400/0xcf9477fddcf1ee55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee5c expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791016.560422:0:20706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787791016.560431:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.560438:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.560444:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.560450:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560480:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791016.560487:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560493:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165f000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791016.560497:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560505:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791016.560511:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791016.560517:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787791016.560519:0:17122:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787791016.560553:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560558:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791016.560590:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560598:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791016.560599:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791016.560601:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791016.560646:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787791016.560659:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791016.560695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791016.560858:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164608 00000100:00100000:1.0:1787791016.560864:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164608 00000100:00100000:1.0:1787791016.560907:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791016.560914:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+21:3639:x1874634268164608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791016.560924:0:17120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791016.560933:0:17120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539e00/0xcf9477fddcf1f0cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1f0c4 expref: 21 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.560944:0:17120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791016.560973:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:3639:x1874634268164608:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791016.560979:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787791016.561060:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791016.561450:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791016.561455:0:20706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c165f000/0xcf9477fddcf1f0c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0cb expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791016.561466:0:20706:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787791016.561474:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.561481:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.561486:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791016.561493:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.561534:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791016.561541:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.561547:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad5800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:2.0:1787791016.561556:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.561563:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787791016.561570:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791016.561576:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787791016.561579:0:17123:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1787791016.561598:0:17123:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.561604:0:17123:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787791016.561658:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791016.561690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787791016.561791:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791016.561801:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791016.561802:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791016.561804:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791016.561916:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164736 00000100:00100000:1.0:1787791016.561921:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164736 00000100:00100000:1.0:1787791016.561959:0:17121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787791016.561967:0:17121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+20:3639:x1874634268164736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791016.561976:0:17121:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791016.561988:0:17121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994200/0xcf9477fddcf1eb06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1eaff expref: 20 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791016.562018:0:17121:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787791016.562127:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791016.562133:0:20706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad5800/0xcf9477fddcf1eaff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1eb06 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791016.562144:0:20706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1787791016.562147:0:20706:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787791016.562150:0:20706:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787791016.562181:0:20706:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787791016.562185:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787791016.562190:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791016.562196:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787791016.562201:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff916fc1dd6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791016.562206:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff916fc1dd2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791016.562211:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff916fc3932800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791016.562215:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9170d6150000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791016.562222:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff916fc1dd3000 3648b1be-585a-40cf-a928-57e0e7a37168 192.168.202.22@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787791016.562227:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff916fc46ea800 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 192.168.202.22@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787791016.562232:0:20706:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9170fbee99b8) has exports, disconnecting them 00000020:00080000:0.0:1787791016.562236:0:20706:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff916fc1dd6000), last request at 1787791014 00000020:00000080:0.0:1787791016.562242:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee24 00000100:00080000:0.0:1787791016.562268:0:20706:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787791016.562317:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc1dd6000): rc 0 00000020:00000080:0.0:1787791016.562320:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc1dd6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787791016.562329:0:20706:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff916fc1dd2000), last request at 1787791014 00000020:00000080:0.0:1787791016.562333:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed8a 00000100:00080000:0.0:1787791016.562344:0:20706:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd2800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787791016.562358:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1dd6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787791016.562400:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1dd4000 for lustre-MDT0000 00000020:00080000:0.0:1787791016.562414:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc1dd2000): rc 0 00000020:00000080:0.0:1787791016.562416:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc1dd2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787791016.562424:0:20706:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff916fc3932800), last request at 1787790947 00000020:00000080:0.0:1787791016.562428:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ece2 00000100:00080000:0.0:1787791016.562432:0:20706:0:(import.c:65:import_set_state_nolock()) ffff916fc3934000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787791016.562440:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1dd2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787791016.562463:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1dd2800 for lustre-MDT0000 00000020:00080000:0.0:1787791016.562474:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc3932800): rc 0 00000020:00000080:0.0:1787791016.562475:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc3932800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787791016.562482:0:20706:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9170d6150000), last request at 1787790947 00000020:00000080:0.0:1787791016.562486:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec79 00000100:00080000:0.0:1787791016.562490:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9171011a9000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787791016.562498:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3932800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787791016.562520:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc3934000 for lustre-MDT0000 00000001:00000004:0.0:1787791016.562531:0:20706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1787791016.562606:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170d6150000): rc 0 00000004:00000080:0.0:1787791016.562612:0:20706:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa8b30807fae0 00000100:00080000:0.0:1787791016.562645:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787791016.562649:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787791016.563469:0:20706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787791016.563495:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787791016.563997:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268164864:0@lo:39:umount.0 00000100:00100000:2.0:1787791016.564078:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791016.564151:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164864 00000100:00100000:2.0:1787791016.564158:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164864 00000100:00100000:2.0:1787791016.564206:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787791016.564214:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268164864:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787791016.564239:0:17139:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed05 00000100:00080000:2.0:1787791016.564247:0:17139:0:(import.c:65:import_set_state_nolock()) ffff916fc3936800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787791016.564262:0:17139:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787791016.564410:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3637:x1874634268164864:12345-0@lo:39:umount.0 Request processed in 195us (331us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787791016.564418:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1787791016.564446:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791016.564477:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170eef42800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787791016.564485:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268164864:0@lo:39:umount.0 00010000:00010000:2.0:1787791016.564498:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787791016.564759:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787791016.564762:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787791016.564786:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787791016.564851:0:20706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787791016.564875:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787791016.564888:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787791016.564890:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787791016.564901:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787791016.564964:0:20706:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787791016.564975:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787791016.565014:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9170fbee99b8) has no exports 00000100:00100000:2.0:1787791016.565401:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268164992:0@lo:9:umount.0 00000100:00100000:2.0:1787791016.565446:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791016.565475:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268165120:0@lo:9:umount.0 00000100:00100000:2.0:1787791016.565494:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791016.565527:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268164992 00000100:00100000:2.0:1787791016.565532:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268164992 00000100:00100000:2.0:1787791016.565578:0:19573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165120 00000100:00100000:2.0:1787791016.565581:0:19573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165120 00000100:00100000:2.0:1787791016.565600:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787791016.565607:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268164992:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787791016.565638:0:19573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee63 00000100:00080000:2.0:1787791016.565645:0:19573:0:(import.c:65:import_set_state_nolock()) ffff916fc46a1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787791016.565678:0:19573:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787791016.565826:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3637:x1874634268164992:12345-0@lo:9:umount.0 Request processed in 218us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791016.565834:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787791016.565848:0:19573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787791016.565855:0:19573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874634268165120:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787791016.565866:0:19573:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee6a 00000100:00080000:2.0:1787791016.565872:0:19573:0:(import.c:65:import_set_state_nolock()) ffff916fc46a3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787791016.565904:0:19573:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787791016.565975:0:19573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3637:x1874634268165120:12345-0@lo:9:umount.0 Request processed in 120us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791016.565982:0:19573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787791016.566005:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791016.566234:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791016.566281:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6142800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787791016.566292:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787791016.566294:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791016.566297:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268164992:0@lo:9:umount.0 00000100:00080000:2.0:1787791016.566310:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6145800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787791016.566313:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787791016.566315:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791016.566317:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268165120:0@lo:9:umount.0 00000100:00100000:1.0:1787791016.566577:0:17121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe65e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3639:x1874634268164736:12345-0@lo:103:ldlm_bl.0 Request processed in 4608us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791016.566586:0:17121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1787791016.566728:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791016.567406:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3639:1874634268164736:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787791016.567432:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787791016.567445:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1787791016.582974:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9170fbee99b8) has no exports 00000020:00000080:1.0:1787791016.662874:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb5a 00000020:00000080:1.0:1787791016.662895:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc344f000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787791016.662915:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787791016.662956:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc344f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787791016.667059:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791016.667077:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787791016.667083:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9170fbeeb370) has no exports 00000020:00000080:0.0:1787791016.667497:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb53 00000020:00000080:0.0:1787791016.667507:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170f3c79000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791016.667573:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791016.667580:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787791016.667583:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170f3c7a800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787791016.667585:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c7a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787791016.667597:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1787791016.667802:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3c79000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787791017.233094:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791018.250880:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791018.827051:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787791018.827077:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268165248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791018.827150:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791018.827248:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165248 00000100:00100000:1.0:1787791018.827257:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165248 00000100:00080000:0.0:1787791018.827541:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787791018.828842:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787791018.828860:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268165248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787791018.828898:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791018.829006:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268165248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791018.829018:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787791018.829306:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268165248:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1787791018.831996:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787791018.832010:0:17114:0:(genops.c:885:class_export_put()) final put ffff9170d6150000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787791018.832048:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00080000:2.0:1787791018.832058:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1787791018.832063:0:17114:0:(genops.c:885:class_export_put()) final put ffff916fc1dd3000/3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:2.0:1787791018.832069:0:17114:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00080000:2.0:1787791018.832074:0:17114:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1787791018.832082:0:17114:0:(genops.c:885:class_export_put()) final put ffff916fc46ea800/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000020:00000080:3.0:1787791018.832816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6150000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1787791018.832951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc1dd3000/3648b1be-585a-40cf-a928-57e0e7a37168 for lustre-MDT0000 00000020:00000080:3.0:1787791018.832992:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46ea800/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 for lustre-MDT0000 00000020:00000080:3.0:1787791018.833036:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9171011a9000 for lustre-MDT0000 00000020:00000080:3.0:1787791018.833042:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1dd7800 for lustre-MDT0000 00000020:00000080:3.0:1787791018.833045:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46ed800 for lustre-MDT0000 00000001:00100000:1.0:1787791018.834371:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787791018.834393:0:17867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1787791018.834400:0:17867:0:(genops.c:885:class_export_put()) final put ffff9170f67ca000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787791018.834424:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00080000:1.0:1787791018.834429:0:17867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1787791018.834431:0:17867:0:(genops.c:885:class_export_put()) final put ffff9170f3de7800/3648b1be-585a-40cf-a928-57e0e7a37168 00000001:00100000:1.0:1787791018.834437:0:17867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000001:00080000:1.0:1787791018.834441:0:17867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1787791018.834453:0:17867:0:(genops.c:885:class_export_put()) final put ffff916fc46e8000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 00000020:00000080:0.0:1787791018.834501:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67ca000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787791018.834622:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3de7800/3648b1be-585a-40cf-a928-57e0e7a37168 for lustre-MDT0001 00000020:00000080:0.0:1787791018.834651:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e8000/29c6d674-d9ba-4bbf-a4c9-b118e1c0ab32 for lustre-MDT0001 00000020:00000080:0.0:1787791018.834674:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc3936800 for lustre-MDT0001 00000020:00000080:0.0:1787791018.834679:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f3de0000 for lustre-MDT0001 00000020:00000080:0.0:1787791018.834681:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46eb800 for lustre-MDT0001 00000040:00080000:2.0:1787791019.211480:0:17887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787791019.275020:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791019.339340:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787791019.339374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268165376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791019.339625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.343065:0:18216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165376 00000100:00100000:0.0:1787791019.343879:0:18216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165376 00000100:00100000:0.0:1787791019.344007:0:18216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787791019.344019:0:18216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874634268165376:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787791019.344031:0:18216:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787791019.344156:0:18216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3640:x1874634268165376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (4539us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787791019.344164:0:18216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:02020000:1.0:1787791019.345862:0:3640:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1787791019.357145:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787791019.357153:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787791019.357158:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787791019.366008:0:3640:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791019.366021:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1787791019.366030:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170d614f800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791019.366071:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ada40 x1874634268165504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787791019.366181:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268165504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787791019.366258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791019.366343:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165504 00000100:00100000:1.0:1787791019.366351:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165504 00000100:00100000:1.0:1787791019.366394:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787791019.366401:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268165504:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787791019.366419:0:17140:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787791019.371213:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268165504:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 4800us (4943us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787791019.371229:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787791019.371311:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787791019.371317:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787791019.371322:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268165504:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787791019.851605:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268165632:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.851690:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791019.851854:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268165760:0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.851891:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791019.851924:0:18643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165760 00000100:00100000:3.0:1787791019.851931:0:18643:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165760 00000100:00100000:3.0:1787791019.851978:0:18643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787791019.851988:0:18643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268165760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.852044:0:18643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe643c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268165760:12345-0@lo:400:kworker.0 Request processed in 58us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791019.852065:0:18643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787791019.852104:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268166016:0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.852141:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791019.852309:0:17127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165632 00000100:00100000:1.0:1787791019.852313:0:17127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165632 00000100:00100000:1.0:1787791019.852342:0:17127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787791019.852350:0:17127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3638:x1874634268165632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791019.852388:0:17127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5041f1dd-aadb-4baa-80c4-90de68fcfbb8+19:3638:x1874634268165632:12345-0@lo:400:kworker.0 Request processed in 39us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791019.852411:0:17127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1787791019.852456:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268165888:0@lo:400:kworker.0 00000100:00100000:1.0:1787791019.852482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.852677:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268165632:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.852684:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268166144:0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.852854:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268165760:0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.852863:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268166272:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.852909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791019.852981:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268166528:0@lo:400:kworker.0 00000100:00100000:1.0:1787791019.853012:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268166400:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.853114:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268166656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787791019.853149:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.853181:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166656 00000100:00100000:0.0:1787791019.853185:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166656 00000100:00100000:0.0:1787791019.853223:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787791019.853230:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268166656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787791019.853257:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791019.853293:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268166656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791019.853300:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1787791019.853316:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791019.853328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791019.853391:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268166656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791019.853624:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268165888 00000100:00100000:1.0:1787791019.853629:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268165888 00000100:00100000:1.0:1787791019.853656:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787791019.853664:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268165888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791019.853719:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268165888:12345-0@lo:400:kworker.0 Request processed in 40us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791019.853725:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787791019.858454:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166016 00000100:00100000:3.0:1787791019.858470:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166016 00000100:00100000:3.0:1787791019.858523:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166144 00000100:00100000:3.0:1787791019.858527:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166144 00000100:00100000:3.0:1787791019.858540:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166528 00000100:00100000:3.0:1787791019.858558:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166528 00000100:00100000:3.0:1787791019.858611:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787791019.858622:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268166528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791019.858724:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268166528:12345-0@lo:400:kworker.0 Request processed in 105us (5394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791019.858731:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787791019.859483:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787791019.859491:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1874634268166016:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787791019.859498:0:18527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787791019.859549:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbe66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3641:x1874634268166016:12345-0@lo:400:kworker.0 Request processed in 57us (7407us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787791019.859555:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787791019.859575:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787791019.859579:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1874634268166144:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787791019.859583:0:18527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787791019.859627:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3638:x1874634268166144:12345-0@lo:400:kworker.0 Request processed in 45us (6892us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787791019.859632:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787791019.859676:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787791019.859682:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787791019.859685:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787791019.859691:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791019.859694:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1787791019.859700:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170f67c8800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791019.859817:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4f46d00 x1874634268166784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791019.859843:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268166016:0@lo:400:kworker.0 00010000:00080000:0.0:1787791019.859861:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f46940 x1874634268166528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791019.859872:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268166528:0@lo:400:kworker.0 00000100:00080000:0.0:1787791019.859909:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787791019.859972:0:3638:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787791019.859976:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787791019.859986:0:3638:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791019.859989:0:3638:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 510 00000100:00080000:0.0:1787791019.859993:0:3638:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc1dd4800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791019.860007:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4f46940 x1874634268166912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791019.860017:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268166144:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.860120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.860309:0:18527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166400 00000100:00100000:0.0:1787791019.860314:0:18527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166400 00000100:00100000:0.0:1787791019.860335:0:18527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787791019.860340:0:18527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874634268166400:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787791019.860345:0:18527:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787791019.860371:0:18527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3640:x1874634268166400:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787791019.860377:0:18527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1787791019.860402:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787791019.860405:0:3640:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787791019.860407:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787791019.860410:0:3640:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791019.860413:0:3640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 525 00000100:00080000:0.0:1787791019.860417:0:3640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc46a2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791019.860431:0:3640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4f44780 x1874634268167040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791019.860441:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f45680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268166400:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.860475:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268165888:0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.860502:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268166784:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787791019.860532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.860545:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268166912:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787791019.860560:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.860569:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268167040:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787791019.860585:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.862396:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166784 00000100:00100000:0.0:1787791019.862411:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166784 00000100:00100000:0.0:1787791019.862439:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166912 00000100:00100000:0.0:1787791019.862442:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166912 00000100:00100000:0.0:1787791019.862450:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167040 00000100:00100000:0.0:1787791019.862452:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167040 00000100:00100000:0.0:1787791019.862467:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787791019.862474:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268166784:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1787791019.862493:0:17134:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787791019.862585:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268166784:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 108us (2050us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791019.862604:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787791019.862621:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787791019.862625:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268166912:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787791019.862632:0:17134:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787791019.862656:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268166912:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (2096us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791019.862662:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787791019.862672:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787791019.862683:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268167040:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787791019.862692:0:17134:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787791019.862795:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268167040:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (2146us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791019.862802:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787791019.862842:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791019.862848:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791019.862852:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268166784:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1787791019.862862:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791019.862865:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791019.862868:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f46940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268166912:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1787791019.862875:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791019.862878:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791019.862880:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268167040:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1787791019.862998:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787791019.863014:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791019.863120:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268166272 00000100:00100000:0.0:1787791019.863211:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268166272 00000100:00100000:0.0:1787791019.863254:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787791019.863260:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268166272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791019.863304:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268166272:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791019.863311:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787791019.863324:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787791019.863346:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170e4f44000 x1874634268166272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791019.863373:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268166272:0@lo:400:kworker.0 00010000:00010000:2.0:1787791020.298965:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791021.322984:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787791021.902397:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787791021.902410:0:18637:0:(genops.c:885:class_export_put()) final put ffff916fc46a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787791021.902495:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787791021.902567:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a1800 for lustre-OST0000 00000001:00100000:0.0:1787791021.903239:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787791021.903244:0:19455:0:(genops.c:885:class_export_put()) final put ffff916fc46a4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787791021.903312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787791021.906225:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a3000 for lustre-OST0001 00010000:00010000:1.0:1787791022.347019:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787791022.730905:0:20706:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1dd9e40 - data ffff9170d1b52438/ffff9170fe1fdc00 00000020:01000000:0.0:1787791022.731077:0:20706:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170e0d04960 - data ffff9170d6a2fa20/ffff9170fe12b800 00000001:00000004:0.0:1787791022.741307:0:20706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:2.0:1787791022.832013:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787791022.832027:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787791022.832046:0:20706:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9170f67f0b40 x1874634268164864/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787791026 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791022.832079:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787791022.839361:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787791022.841659:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1787791022.841693:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791022.841697:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787791022.847069:0:17158:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787791022.847083:0:17158:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1787791022.847118:0:17158:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787791022.848441:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787791022.848450:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1787791022.848480:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791022.848489:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787791022.849584:0:17160:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787791022.849610:0:17160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1787791022.849625:0:17160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787791022.855168:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb22 00000020:00000080:2.0:1787791022.855186:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef43800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791022.856216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787791022.859249:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb37 00000020:00000080:2.0:1787791022.859272:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef43000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787791022.859294:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787791022.859301:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.859332:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787791022.859337:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9170fbeecd28) has no exports 00000020:00000080:0.0:1787791022.860742:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef43000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787791022.861204:0:20706:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787791022.861220:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb99 00000020:00000080:2.0:1787791022.861233:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170d6146800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787791022.861261:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787791022.861273:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.861282:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787791022.861287:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff916fc34a8000) has no exports 00000020:00000080:2.0:1787791022.861296:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb92 00000020:00000080:2.0:1787791022.861300:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170d6145000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791022.863177:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6146800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787791022.863202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6145000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787791022.864936:0:20706:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787791022.864949:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787791022.864955:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1787791022.864967:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791022.864971:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787791022.865057:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.865074:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791022.865100:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb84 00000020:00000080:2.0:1787791022.865114:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170d6141800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787791022.865122:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787791022.865132:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.865138:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787791022.865142:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff916fc34ab370) has no exports 00000020:00000080:2.0:1787791022.865150:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb7d 00000020:00000080:2.0:1787791022.865155:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170c8f96800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791022.865629:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d6145800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787791022.865642:0:8:0:(genops.c:885:class_export_put()) final put ffff9170d6143800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787791022.865644:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6143800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787791022.865655:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787791022.865818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6141800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787791022.865824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c8f96800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787791022.872441:0:20706:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787791022.872454:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787791022.873299:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1787791022.873314:0:20706:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791022.873317:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791022.873960:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d6142800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787791022.874694:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.876991:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791022.877002:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170c82e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787791022.877008:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c82e4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787791022.877028:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1787791022.877187:0:20706:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787791022.877199:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb6f 00000020:00000080:2.0:1787791022.877208:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170c82e7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787791022.877232:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1787791022.877237:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.877245:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787791022.877250:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9170fc1319b8) has no exports 00000020:00000080:2.0:1787791022.877260:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb68 00000020:00000080:2.0:1787791022.877265:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef46000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791022.878645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c82e7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787791022.878666:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef46000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787791022.911396:0:20706:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1787791022.911410:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787791022.911417:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787791022.911429:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787791022.911620:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.911636:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791022.911677:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.911680:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791022.911687:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef41800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787791022.911693:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef41800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787791022.911720:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791022.913883:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb3e 00000020:00000080:2.0:1787791022.913916:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef47000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787791022.928030:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170eef42800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787791022.928077:0:8:0:(genops.c:885:class_export_put()) final put ffff916fc3449800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787791022.928083:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3449800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787791022.928106:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787791022.932084:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787791022.932108:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.932125:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787791022.932132:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9170fbee8000) has no exports 00000020:00000080:2.0:1787791022.932181:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.932207:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787791022.932217:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eb45 00000020:00000080:2.0:1787791022.932228:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef42000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787791022.932243:0:20706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff916fc46e5000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787791022.932248:0:20706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff916fc46e5000 3 00000020:01000004:2.0:1787791022.932252:0:20706:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff916fc46e5000 from lustre-MDT0000 00000020:00000080:2.0:1787791022.932281:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787791022.932285:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787791022.932288:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef47800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787791022.932291:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef47800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787791022.932306:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787791022.932409:0:20706:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1787791022.932414:0:20706:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787791022.932417:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787791022.932420:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791022.932423:0:20706:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787791022.932431:0:20706:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9170c355f800 5041f1dd-aadb-4baa-80c4-90de68fcfbb8 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787791022.932437:0:20706:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff916fc32099b8) has exports, disconnecting them 00000020:00080000:2.0:1787791022.932443:0:20706:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9170c355f800), last request at 1787790933 00000020:00000080:2.0:1787791022.932462:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eaea 00000020:00010000:2.0:1787791022.932466:0:20706:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9170c355f800: total 2 00000100:00080000:2.0:1787791022.932472:0:20706:0:(import.c:65:import_set_state_nolock()) ffff9170c355a800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787791022.932494:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170c355f800): rc 0 00000020:00080000:2.0:1787791022.932498:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff916fc32099b8) has no exports 00000020:00010000:2.0:1787791022.932522:0:17123:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9170c355f800: total 2 00010000:00010000:2.0:1787791022.932527:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791022.932552:0:17123:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9170c355f800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1787791022.932602:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fac00/0xcf9477fddcf1ed4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ed44 expref: 14 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932624:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995400/0xcf9477fddcf1ede5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1edde expref: 13 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932646:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994a00/0xcf9477fddcf1ec09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ec02 expref: 12 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932660:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3995a00/0xcf9477fddcf1ecc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ecbf expref: 11 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932671:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad5400/0xcf9477fddcf1ec17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ec10 expref: 10 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932685:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f0af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1f0a8 expref: 9 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932695:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994000/0xcf9477fddcf1ec25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ec1e expref: 8 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932733:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539000/0xcf9477fddcf1eaf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1eaf1 expref: 7 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.932745:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f0bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1f0b6 expref: 6 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787791022.932951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef47000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787791022.932958:0:8:0:(genops.c:885:class_export_put()) final put ffff9170eef45000/lustre-MDD0000_UUID 00000020:00000080:1.0:1787791022.932960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef45000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787791022.932969:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787791022.933052:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef42000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787791022.934919:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4538600/0xcf9477fddcf1ed75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ed6e expref: 5 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.934970:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f0a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1f09a expref: 4 pid: 17128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.934986:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb400/0xcf9477fddcf1ee0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ee08 expref: 3 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.935026:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3ad4a00/0xcf9477fddcf1ee4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf9477fddcf1ee47 expref: 2 pid: 17127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791022.935040:0:17123:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9170c355f800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1787791022.935084:0:17123:0:(genops.c:885:class_export_put()) final put ffff9170c355f800/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 00010000:00010000:2.0:1787791022.935167:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791022.935170:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791022.935173:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787791022.943459:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c355f800/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 for MGS 00000020:00000080:0.0:1787791022.946931:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170c355a800 for MGS 00000100:00100000:0.0:1787791022.979205:0:17128:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9170fbd63c00:17128] 1 exiting: rc = 0 00000100:00100000:1.0:1787791022.982156:0:17127:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff916fc1d30e00:17127] 0 exiting: rc = 1 00000100:00100000:1.0:1787791022.982318:0:17129:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9170fbd62800:17129] 2 exiting: rc = 0 00000100:00100000:0.0:1787791022.982855:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982867:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982874:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982894:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982902:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982909:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982915:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982922:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982929:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982937:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982944:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982950:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982956:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982962:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982968:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982975:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982980:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982986:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982992:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.982998:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983003:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983009:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983014:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983020:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983026:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983031:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983037:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983058:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983064:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983071:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983078:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983084:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983091:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983096:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983102:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983107:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983120:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983127:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983133:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983139:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983144:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983151:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983157:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983163:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983169:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983175:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983181:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983186:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983192:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983198:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983204:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983210:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983217:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983223:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983228:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983234:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983239:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983244:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983249:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983255:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983261:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983267:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983278:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791022.983285:0:20706:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787791022.984441:0:20706:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170edb00a20 - data ffff9170d6900438/ffff9170fe184400 00000020:01000000:0.0:1787791022.984599:0:20706:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170e0d04720 - data ffff916fc2160948/ffff9170fc24b800 00000020:00000080:1.0:1787791022.990008:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eace 00000020:00000080:1.0:1787791022.990154:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc46e4800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787791022.990195:0:20706:0:(tgt_mount.c:187:server_put_mount()) put mount ffff916fc46e5000 from MGS, refs=2 00000020:01000004:1.0:1787791022.990200:0:20706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff916fc46e5000 2 00000020:01000004:1.0:1787791022.990204:0:20706:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff916fc46e5000 from MGS 00000020:00000080:0.0:1787791022.990233:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787791022.990236:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787791022.990252:0:20706:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787791022.990256:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc46e7800/MGS 00000020:00000080:1.0:1787791022.990260:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e7800/MGS for MGS 00000020:01000000:1.0:1787791022.990270:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787791022.990337:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787791022.990341:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787791022.990347:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787791022.990354:0:20706:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9170eef40800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787791022.990360:0:20706:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9170facf3370) has exports, disconnecting them 00000020:00080000:1.0:1787791022.990365:0:20706:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9170eef40800), last request at 1787790933 00000020:00000080:1.0:1787791022.990369:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ebd1 00000020:00080000:1.0:1787791022.990384:0:20706:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170eef40800): rc 0 00000020:00000080:1.0:1787791022.990389:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170eef40800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787791022.990431:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170eef40800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787791023.015486:0:20706:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787791023.015497:0:20706:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787791023.015502:0:20706:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787791023.015511:0:20706:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791023.015574:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170ce83e800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787791023.019071:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791023.019090:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787791023.019098:0:20706:0:(genops.c:885:class_export_put()) final put ffff9170ce83d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787791023.019104:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ce83d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787791023.019113:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787791023.019228:0:20706:0:(obd_mount.c:710:lustre_put_lsi()) put ffff916fc46e5000 1 00000020:00000080:0.0:1787791023.019235:0:20706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eac0 00000020:00000080:0.0:1787791023.019244:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc46e5800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787791023.019268:0:20706:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787791023.019272:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791023.019277:0:20706:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787791023.019281:0:20706:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff916fc320b370) has no exports 00000020:00000080:1.0:1787791023.019310:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787791023.073622:0:20706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791023.073901:0:20706:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787791023.073910:0:20706:0:(genops.c:885:class_export_put()) final put ffff916fc46e6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787791023.073917:0:20706:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787791023.073926:0:20706:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787791023.074098:0:20706:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff916fc46e7000 00000020:02000400:0.0:1787791023.074304:0:20706:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787791023.370846:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791023.947283:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791023.947306:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268167168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787791023.947415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791023.947505:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167168 00000100:00100000:1.0:1787791023.947516:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167168 00000100:00100000:1.0:1787791023.947601:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787791023.947613:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268167168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787791023.947669:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791023.947760:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268167168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791023.947770:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787791023.947798:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787791023.947846:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268167168:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787791024.396115:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791024.971431:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787791024.971470:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268167296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791024.971571:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791024.974332:0:18645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167296 00000100:00100000:2.0:1787791024.974351:0:18645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167296 00000100:00100000:2.0:1787791024.974568:0:18645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787791024.974584:0:18645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268167296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787791024.974636:0:18645:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787791024.974778:0:18645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268167296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 198us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791024.974786:0:18645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787791024.975083:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791024.976198:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1787791024.978103:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787791024.978117:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787791024.978123:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791024.978135:0:15159:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787791024.978144:0:15159:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787791024.978155:0:15159:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170d614f800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791024.978223:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a56580 x1874634268167552/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791024.978287:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787791024.978291:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787791024.978293:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791024.978297:0:15159:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787791024.978301:0:15159:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787791024.978304:0:15159:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170f67c8800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791024.978330:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268167680:0@lo:400:kworker.0 00000100:00100000:2.0:1787791024.979015:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268167552:0@lo:38:kworker.0 00000100:00100000:2.0:1787791024.979068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791024.979297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791024.979391:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268167296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791024.979592:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5ada40 x1874634268167808/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791024.979613:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787791024.979618:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787791024.979621:0:15159:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791024.979625:0:15159:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787791024.979629:0:15159:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787791024.979635:0:15159:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc1dd4800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791024.979649:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5d6940 x1874634268167936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791024.979675:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787791024.979679:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787791024.979680:0:15159:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791024.979684:0:15159:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 568 00000100:00080000:1.0:1787791024.979686:0:15159:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787791024.979786:0:15159:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc46a2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791024.979796:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791024.979806:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268168064:0@lo:400:kworker.0 00000100:00100000:1.0:1787791024.979851:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791024.979891:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268167808:0@lo:38:kworker.0 00000100:00100000:1.0:1787791024.979917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791024.980083:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268167936:0@lo:38:kworker.0 00000100:00100000:1.0:1787791024.980127:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791024.980166:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168064 00000100:00100000:1.0:1787791024.980174:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168064 00000100:00100000:1.0:1787791024.980321:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167808 00000100:00100000:1.0:1787791024.980325:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167808 00000100:00100000:1.0:1787791024.980339:0:19928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167936 00000100:00100000:1.0:1787791024.980342:0:19928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167936 00000100:00100000:1.0:1787791024.980356:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787791024.980368:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268168064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791024.980426:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268168064:12345-0@lo:400:kworker.0 Request processed in 61us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791024.980434:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787791024.980624:0:18640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167680 00000100:00100000:2.0:1787791024.980630:0:18640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167680 00000100:00100000:2.0:1787791024.980668:0:18640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787791024.980676:0:18640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791024.980760:0:18640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268167680:12345-0@lo:400:kworker.0 Request processed in 85us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791024.980768:0:18640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787791024.980947:0:19928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787791024.980953:0:19928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874634268167808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787791024.980978:0:19928:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787791024.985726:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787791024.985746:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268167936:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787791024.985801:0:17134:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787791024.985928:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268167936:12345-0@lo:38:kworker.0 Request processed in 184us (5799us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791024.985938:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787791024.985993:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268167552 00000100:00100000:0.0:1787791024.986002:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268167552 00000100:00100000:0.0:1787791024.986039:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787791024.986045:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268167552:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787791024.986056:0:17139:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787791024.986087:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268167552:12345-0@lo:38:kworker.0 Request processed in 41us (7019us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791024.986093:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787791024.986125:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787791024.986170:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791024.986177:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791024.986182:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268167936:0@lo:38:kworker.0 00000100:00080000:0.0:1787791024.986212:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791024.986216:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791024.986219:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268167552:0@lo:38:kworker.0 00000100:00100000:0.0:1787791024.986256:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268167424:0@lo:400:kworker.0 00000400:00000100:0.0:1787791024.986290:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268167424 offset 0 length 224: 4 00000100:00100000:2.0:1787791024.989061:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170f67f2940 x1874634268168192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791024.989796:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268168192:0@lo:38:kworker.0 00000100:00100000:0.0:1787791024.989907:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791024.990921:0:17134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168192 00000100:00100000:0.0:1787791024.990954:0:17134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168192 00000100:00100000:0.0:1787791024.991682:0:17134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787791024.992295:0:17134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268168192:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787791024.992328:0:17134:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787791024.993287:0:17134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268168192:12345-0@lo:38:kworker.0 Request processed in 147us (2530us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791024.993305:0:17134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787791024.993374:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268168320:0@lo:400:kworker.0 00000100:00080000:2.0:1787791024.993777:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787791024.993784:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787791024.993790:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268168192:0@lo:38:kworker.0 00000100:00100000:0.0:1787791024.995078:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791024.995347:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168320 00000100:00100000:2.0:1787791024.995358:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168320 00000100:00100000:2.0:1787791024.996113:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787791024.996134:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268168320:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787791024.996620:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787791024.997380:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268168320:12345-0@lo:400:kworker.0 Request processed in 1249us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791024.997396:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1787791024.997797:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff916fc3767480 x1874634268168320/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791024.997828:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268168320:0@lo:400:kworker.0 00010000:00080000:2.0:1787791024.998872:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff916fc45f7840 x1874634268168064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791024.998890:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268168064:0@lo:400:kworker.0 00000100:00100000:2.0:1787791024.998908:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268167680:0@lo:400:kworker.0 00000100:00100000:0.0:1787791025.037532:0:19928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3637:x1874634268167808:12345-0@lo:38:kworker.0 Request processed in 56567us (57603us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787791025.037561:0:19928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1787791025.041889:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791025.041911:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787791025.041918:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268167808:0@lo:38:kworker.0 00010000:00010000:0.0:1787791025.431273:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791026.452022:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787791027.396930:0:20907:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787791027.419047:0:20907:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787791027.419152:0:20907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.419254:0:20907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.419264:0:20907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.419273:0:20907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.419400:0:20907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787791027.419408:0:20907:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787791027.419442:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791027.419448:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787791027.419455:0:20907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787791027.419462:0:20907:0:(import.c:65:import_set_state_nolock()) ffff9170f67c8800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787791027.419468:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791027.419470:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787791027.419473:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787791027.421909:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791027.421933:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791027.421949:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791027.421955:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791027.421967:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791027.422000:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791027.422007:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787791027.422010:0:17122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787791027.422016:0:17122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787791027.422077:0:17122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791027.422084:0:17122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791027.422117:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791027.422126:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3994600/0xcf9477fddcf1ecbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ecc6 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791027.422145:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791027.422147:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791027.422149:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791027.422188:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791027.422288:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791027.423508:0:17120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168448 00000100:00100000:0.0:1787791027.423532:0:17120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168448 00000100:00100000:0.0:1787791027.423600:0:17120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787791027.423610:0:17120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1874634268168448:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787791027.423619:0:17120:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787791027 with bad export cookie 14957712194621532906 00010000:00010000:2.0:1787791027.425895:0:20907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.425918:0:20907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.425926:0:20907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.425934:0:20907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.425959:0:20907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787791027.425966:0:20907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.425972:0:20907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426003:0:20907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426010:0:20907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426024:0:20907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787791027.426031:0:20907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426038:0:20907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426044:0:20907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426050:0:20907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426062:0:20907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787791027.426068:0:20907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426075:0:20907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426081:0:20907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426099:0:20907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791027.426107:0:20907:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787791027.426112:0:20907:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787791027.426154:0:20907:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787791027.426159:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00010000:00010000:3.0:1787791027.426813:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787791027.426824:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.426834:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fb600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787791027.426839:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.426850:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791027.426857:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791027.426863:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787791027.426866:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:3.0:1787791027.426870:0:19471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:3.0:1787791027.426922:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.426943:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787791027.426981:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.426989:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fb600/0xcf9477fddcf1ec1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec25 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427005:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787791027.427008:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427015:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3ad4c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787791027.427018:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427024:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791027.427031:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791027.427037:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787791027.427039:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787791027.427042:0:19471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787791027.427055:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427061:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787791027.427067:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427084:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3ad4c00/0xcf9477fddcf1ee47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ee4e expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427100:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787791027.427104:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427109:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787791027.427112:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427119:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791027.427126:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791027.427132:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787791027.427134:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787791027.427136:0:19471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787791027.427151:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.427158:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1787791027.429041:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791027.429063:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787791027.429074:0:20907:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff916fc46a5000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787791027.429083:0:20907:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff916fc3935800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787791027.429089:0:20907:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff916fc320cd28) has exports, disconnecting them 00000020:00080000:2.0:1787791027.429095:0:20907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff916fc46a5000), last request at 1787791024 00000020:00000080:2.0:1787791027.429105:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee39 00000100:00080000:2.0:1787791027.429136:0:20907:0:(import.c:65:import_set_state_nolock()) ffff916fc46a5800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787791027.429263:0:20907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc46a5000): rc 0 00000020:00000080:2.0:1787791027.429266:0:20907:0:(genops.c:885:class_export_put()) final put ffff916fc46a5000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787791027.429286:0:20907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff916fc3935800), last request at 1787791024 00000020:00000080:2.0:1787791027.429289:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed9f 00000100:00080000:2.0:1787791027.429299:0:20907:0:(import.c:65:import_set_state_nolock()) ffff916fc393b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787791027.429306:0:20907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc3935800): rc 0 00000020:00000080:2.0:1787791027.429308:0:20907:0:(genops.c:885:class_export_put()) final put ffff916fc3935800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787791027.429316:0:20907:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa8b301857ae0 00000100:00080000:2.0:1787791027.429423:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791027.429437:0:20907:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9170ff5d6580 x1874634268165376/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787791035 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791027.429456:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:3.0:1787791027.430253:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.430270:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4539400/0xcf9477fddcf1f0b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1f0bd expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.430309:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791027.430314:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.430896:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:3.0:1787791027.430905:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.430918:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791027.430927:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791027.430934:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787791027.430937:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787791027.430942:0:19471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787791027.430999:0:19471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.431007:0:19471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787791027.431023:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.431030:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa000/0xcf9477fddcf1ec10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf9477fddcf1ec17 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791027.431047:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791027.431049:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791027.431060:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791027.431093:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268168576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791027.431178:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791027.431241:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787791027.431247:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268168704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791027.431268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791027.431514:0:17119:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787791027.431538:0:17119:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787791027.431651:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787791027.431659:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168576 00000100:00100000:1.0:1787791027.431667:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168576 00000100:00100000:1.0:1787791027.431700:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787791027.431717:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168704 00000100:00100000:1.0:1787791027.431719:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168704 00000100:00100000:1.0:1787791027.432158:0:20908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787791027.432292:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791027.432404:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791027.432435:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787791027.432441:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbe64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791027.432463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791027.432482:0:17121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168960 00000100:00100000:3.0:1787791027.432485:0:17121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168960 00000100:00080000:2.0:1787791027.433657:0:20907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787791027.433669:0:20907:0:(import.c:65:import_set_state_nolock()) ffff9170d614f800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1787791027.434446:0:20908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268168576:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787791027.434458:0:20908:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787791027 with bad export cookie 14957712194621532906 00000100:00100000:1.0:1787791027.434727:0:20908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268168576:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (3548us total) trans 0 rc -107/-107 00000100:00080000:2.0:1787791027.434883:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787791027.434889:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787791027.434910:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787791027.434971:0:20907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787791027.435000:0:20907:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787791027.435018:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787791027.435021:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787791027.435030:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787791027.435103:0:20907:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787791027.435114:0:20907:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787791027.435179:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff916fc320cd28) has no exports 00000100:00100000:3.0:1787791027.436788:0:17121:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787791027.436810:0:17121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1787791027.436857:0:17119:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787791027.436868:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268168832 00000100:00100000:3.0:1787791027.436878:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268168832 00000100:00100000:3.0:1787791027.436931:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268169088:0@lo:9:umount.0 00000100:00100000:3.0:1787791027.437017:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791027.437068:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268169216:0@lo:9:umount.0 00000100:00100000:3.0:1787791027.437093:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791027.437234:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268169088 00000100:00100000:3.0:1787791027.437238:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268169088 00000100:00100000:3.0:1787791027.437290:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268169216 00000100:00100000:3.0:1787791027.437293:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268169216 00000100:00100000:3.0:1787791027.437319:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787791027.438306:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874634268169088:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787791027.438456:0:19281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1edc9 00000100:00080000:3.0:1787791027.438468:0:19281:0:(import.c:65:import_set_state_nolock()) ffff9170e02d5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787791027.438730:0:19281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787791027.438965:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1874634268169088:12345-0@lo:9:umount.0 Request processed in 673us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791027.438974:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787791027.439005:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787791027.439013:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874634268169216:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787791027.439029:0:19281:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee71 00000100:00080000:3.0:1787791027.439037:0:19281:0:(import.c:65:import_set_state_nolock()) ffff916fc46a4800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787791027.439054:0:19281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787791027.439136:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1874634268169216:12345-0@lo:9:umount.0 Request processed in 124us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791027.439143:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787791027.439938:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787791027.439944:0:17130:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787791027.440001:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d614d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787791027.440010:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787791027.440013:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787791027.440017:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268169088:0@lo:9:umount.0 00000100:00080000:3.0:1787791027.440031:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170d6153000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787791027.440043:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787791027.440044:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787791027.440047:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268169216:0@lo:9:umount.0 00010000:00010000:3.0:1787791027.440086:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787791027.440110:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787791027.440114:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1787791027.440132:0:3638:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787791027.441479:0:20908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787791027.441578:0:20908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787791027.441589:0:20908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268168704:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787791027.441599:0:20908:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787791027 with bad export cookie 14957712194621532906 00000100:00100000:1.0:1787791027.441759:0:20908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3638:x1874634268168704:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (10488us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787791027.441766:0:20908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787791027.441781:0:20908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787791027.441785:0:20908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc38d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268168960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787791027.441790:0:20908:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787791027 with bad export cookie 14957712194621532906 00000100:00100000:1.0:1787791027.441838:0:20908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc38d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268168960:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (9434us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787791027.441845:0:20908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787791027.441862:0:20908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787791027.441867:0:20908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268168832:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787791027.441872:0:20908:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787791027 with bad export cookie 14957712194621532906 00000100:00100000:1.0:1787791027.441899:0:20908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3641:x1874634268168832:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (9435us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787791027.441904:0:20908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787791027.442414:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787791027.442432:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a5000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:1.0:1787791027.446988:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268165376:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787791027.447044:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791027.447187:0:17120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3641:x1874634268168448:12345-0@lo:103:ldlm_bl.0 Request processed in 23575us (24898us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787791027.447201:0:17120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00000080:0.0:1787791027.451454:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3935800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1787791027.451552:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a5800 for lustre-MDT0001 00000020:00000080:0.0:1787791027.451559:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc393b800 for lustre-MDT0001 00000100:00080000:0.0:1787791027.451875:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787791027.460079:0:3638:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.122@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1787791027.460086:0:3638:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787791027.460100:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a54f00 x1874634268167424/t0(0) o400->MGC192.168.202.122@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787791040 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791027.460133:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170e4f44000 x1874634268168448/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787791043 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791027.460144:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe64780 x1874634268168576/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787791043 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791027.460154:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe670c0 x1874634268168704/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787791043 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791027.460174:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe65a40 x1874634268168960/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787791043 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791027.460184:0:3638:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170fbe64f00 x1874634268168832/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787791043 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791027.460312:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3640:1874634268167424:0@lo:400:kworker.0 10000000:01000000:3.0:1787791027.460420:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787791027.460424:0:3638:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787791027.460426:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787791027.460450:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9170facf9800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1787791027.460565:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787791027.460574:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787791027.460593:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3641:1874634268168832:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787791027.460625:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791027.460632:0:3638:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1787791027.460643:0:3638:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170facf9800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791027.460850:0:3638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3767480 x1874634268169344/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787791027.460892:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268168704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787791027.460897:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbe64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3638:1874634268168576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791027.460984:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268169344:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787791027.461047:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268169344 offset 0 length 520: 4 00000020:00080000:0.0:1787791027.464585:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff916fc320cd28) has no exports 00010000:00010000:3.0:1787791027.466881:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787791027.535010:0:20907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1dd92a0 - data ffff9170d69d2360/ffff9170fe1fc400 00000020:01000000:1.0:1787791027.535264:0:20907:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9170f3d96d20 - data ffff9170d6adc0d8/ffff9170f5a56000 00000001:00000004:1.0:1787791027.544504:0:20907:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787791027.601083:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791027.601096:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787791027.601107:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787791027.603998:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787791027.604009:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787791027.604162:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791027.604167:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787791027.606573:0:17875:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787791027.606583:0:17875:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787791027.606598:0:17875:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787791027.607363:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787791027.607372:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787791027.607390:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787791027.607408:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787791027.608067:0:17877:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787791027.608072:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787791027.608084:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787791027.609332:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec33 00000020:00000080:2.0:1787791027.609349:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170c4ccf000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787791027.609590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c4ccf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787791027.610640:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec48 00000020:00000080:2.0:1787791027.610654:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170f6795000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787791027.611076:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787791027.611085:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791027.611096:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787791027.611102:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff916fc3208000) has no exports 00000004:01000000:2.0:1787791027.611295:0:20907:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787791027.611305:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec9c 00000020:00000080:2.0:1787791027.611311:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d6154800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787791027.612947:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6795000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787791027.613204:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787791027.613243:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791027.613256:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787791027.613261:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff916fc34a99b8) has no exports 00000020:00000080:2.0:1787791027.613272:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec95 00000020:00000080:2.0:1787791027.613282:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d6154000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787791027.613902:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6154800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787791027.613919:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6154000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787791027.615153:0:20907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787791027.615162:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787791027.615167:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787791027.615176:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787791027.615179:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791027.615240:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.615251:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787791027.615262:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec87 00000020:00000080:0.0:1787791027.615272:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d6157000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787791027.615278:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787791027.615285:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791027.615288:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787791027.615292:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9170fc130000) has no exports 00000020:00000080:0.0:1787791027.615300:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec80 00000020:00000080:0.0:1787791027.615304:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d614b800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787791027.615987:0:20907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787791027.615992:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787791027.615995:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787791027.616019:0:20907:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787791027.616021:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791027.616059:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.616066:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787791027.616084:0:20907:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787791027.616091:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec6b 00000020:00000080:0.0:1787791027.616098:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d614d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787791027.616103:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787791027.616107:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791027.616111:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787791027.616113:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff916fc34acd28) has no exports 00000020:00000080:0.0:1787791027.616119:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec64 00000020:00000080:0.0:1787791027.616122:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170d614b000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787791027.617749:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d6153000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787791027.617766:0:8:0:(genops.c:885:class_export_put()) final put ffff9170d6156000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787791027.617771:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6156000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787791027.617788:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787791027.617960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6157000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787791027.617967:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d614b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787791027.617973:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d614d000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787791027.617979:0:8:0:(genops.c:885:class_export_put()) final put ffff9170ceb1d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787791027.617981:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170ceb1d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787791027.617985:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787791027.618016:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d614d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787791027.618021:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d614b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1787791027.651539:0:20907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787791027.651554:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787791027.651560:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787791027.651573:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791027.651729:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.651749:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787791027.651804:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.651808:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787791027.651816:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170f503d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787791027.651822:0:20907:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503d800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1787791027.651839:0:20907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787791027.652613:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec4f 00000020:00000080:0.0:1787791027.652630:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170f6794000/lustre-MDD0001_UUID 00000020:00000080:2.0:1787791027.653229:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170d614f800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787791027.653240:0:8:0:(genops.c:885:class_export_put()) final put ffff9170d614f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787791027.653244:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d614f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1787791027.653260:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787791027.654204:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787791027.654213:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791027.654225:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787791027.654231:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9170d6383370) has no exports 00000020:00000080:0.0:1787791027.654263:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.654270:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787791027.654290:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ec56 00000020:00000080:0.0:1787791027.654299:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170f6793000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787791027.654310:0:20907:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170ce839000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787791027.654314:0:20907:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170ce839000 2 00000020:01000004:0.0:1787791027.654317:0:20907:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170ce839000 from lustre-MDT0001 00000020:00000080:0.0:1787791027.654413:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.654418:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787791027.654422:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170c4cca800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787791027.654425:0:20907:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c4cca800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787791027.654437:0:20907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787791027.654495:0:20907:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787791027.654500:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787791027.654503:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791027.654507:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787791027.654515:0:20907:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9170f67c9800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791027.654531:0:20907:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9170facf0000) has exports, disconnecting them 00000020:00080000:0.0:1787791027.654537:0:20907:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9170f67c9800), last request at 1787790947 00000020:00000080:0.0:1787791027.654542:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ecd4 00000020:00080000:0.0:1787791027.654559:0:20907:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170f67c9800): rc 0 00000020:00000080:0.0:1787791027.654563:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170f67c9800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787791027.655450:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6794000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1787791027.655464:0:8:0:(genops.c:885:class_export_put()) final put ffff9170f5038000/lustre-MDD0001_UUID 00000020:00000080:2.0:1787791027.655467:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f5038000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1787791027.655474:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1787791027.656164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f6793000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787791027.656173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67c9800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787791027.665838:0:20907:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787791027.665853:0:20907:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787791027.665859:0:20907:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787791027.665871:0:20907:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787791027.666134:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787791027.666146:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787791027.666155:0:20907:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170ce839000 1 00000020:00000080:1.0:1787791027.666164:0:20907:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ebfb 00000020:00000080:1.0:1787791027.666176:0:20907:0:(genops.c:885:class_export_put()) final put ffff9171011af000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787791027.666183:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787791027.666191:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787791027.666195:0:20907:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787791027.666200:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9170facf4d28) has no exports 00000020:00000080:2.0:1787791027.668837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170f67c8800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1787791027.668856:0:8:0:(genops.c:885:class_export_put()) final put ffff9171011a8800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1787791027.668861:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9171011a8800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1787791027.668871:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1787791027.669007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9171011af000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787791027.753437:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787791027.753458:0:20907:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787791027.753466:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170c5664000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787791027.753474:0:20907:0:(genops.c:844:class_export_destroy()) destroying export ffff9170c5664000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787791027.753493:0:20907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787791027.753682:0:20907:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170ce83c800 00000020:01000000:3.0:1787791027.753842:0:20907:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787791027.753848:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787791027.753853:0:20907:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787791027.753858:0:20907:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9170fc133370) has no exports 00000100:00100000:0.0:1787791027.755720:0:18527:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9170fc214e00:18527] 3 exiting: rc = 0 00000100:00100000:0.0:1787791027.755896:0:19928:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff916fc3463400:19928] 4 exiting: rc = 0 00000100:00100000:1.0:1787791027.757060:0:17134:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91710112f600:17134] 0 exiting: rc = 1 00000100:00100000:3.0:1787791027.757648:0:17135:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9170d63b6e00:17135] 1 exiting: rc = 0 00000100:00100000:3.0:1787791027.757818:0:17136:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9170d63b7e00:17136] 2 exiting: rc = 0 00000100:00100000:1.0:1787791027.758100:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758109:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758116:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758122:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758129:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758135:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758141:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758148:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758154:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758160:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758166:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758174:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758181:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758188:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758195:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758201:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758208:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758214:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758220:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758227:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758234:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758241:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758247:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758254:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758259:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758266:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758296:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758305:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758311:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.758317:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759212:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759224:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759231:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759238:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759245:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759279:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759285:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759292:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759298:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759304:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759311:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759613:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759626:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759631:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759638:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759645:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759652:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759658:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759678:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759685:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759691:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759698:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759725:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759735:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759742:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759749:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759757:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759763:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759770:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759776:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759783:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759790:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759798:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.759805:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.771030:0:17137:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9170d63b6400:17137] 0 exiting: rc = 1 00000100:00100000:3.0:1787791027.772252:0:17138:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9170d63b7800:17138] 1 exiting: rc = 0 00000100:00100000:2.0:1787791027.772458:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772467:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772477:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772483:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772488:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772494:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772500:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772506:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772528:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772535:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772541:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772546:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772553:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772560:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772587:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772592:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772598:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772604:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772610:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772618:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772624:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772630:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772636:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772642:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772648:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772654:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772670:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772677:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772682:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772688:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772694:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772699:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772733:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772741:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772747:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772753:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772758:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772764:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772770:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772776:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772782:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772788:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772793:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772798:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772804:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772811:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772823:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772829:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772836:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772849:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772855:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772861:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772867:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772873:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772879:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772884:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772890:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772896:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772902:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772907:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772912:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772918:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772924:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.772929:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791027.773554:0:17139:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9170fbdb9800:17139] 0 exiting: rc = 1 00000100:00100000:0.0:1787791027.773664:0:18216:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff916fc26c3800:18216] 2 exiting: rc = 0 00000100:00100000:1.0:1787791027.774546:0:17140:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9170fbdb9a00:17140] 1 exiting: rc = 0 00000100:00100000:2.0:1787791027.775613:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775629:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775637:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775643:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775649:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775657:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775674:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775683:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775690:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775737:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775746:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775752:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775759:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775767:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775774:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775781:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775789:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775795:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775801:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775809:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775839:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775861:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775872:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775878:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775886:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775894:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775901:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775908:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775917:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775924:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775931:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775937:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775945:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775967:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775976:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775982:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775989:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.775997:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776004:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776010:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776020:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776027:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776034:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776040:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776046:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776068:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776075:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776082:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776090:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776097:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776105:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776112:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776119:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776125:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776131:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776145:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776152:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776173:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776181:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776186:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776195:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776202:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776209:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.776215:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791027.801421:0:17141:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9170fbdb8c00:17141] 0 exiting: rc = 1 00000100:00100000:1.0:1787791027.801556:0:17142:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9170fbdb9400:17142] 1 exiting: rc = 0 00000100:00100000:3.0:1787791027.801927:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801936:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801942:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801949:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801955:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801961:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801967:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801972:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801978:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801984:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801991:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.801996:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802002:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802008:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802028:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802035:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802041:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802046:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802052:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802057:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802062:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802068:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802073:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802078:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802083:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802090:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802095:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802100:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802125:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802131:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802136:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802142:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802147:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802153:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802161:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802168:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802174:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802179:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802185:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802191:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802197:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802202:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802207:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802214:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802220:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802225:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802231:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802236:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802241:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802247:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802254:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802261:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802267:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802272:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802277:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802284:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802290:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802295:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802302:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802308:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802313:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802331:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802337:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802351:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.802865:0:17143:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff916fc26a2e00:17143] 0 exiting: rc = 1 00000100:00100000:1.0:1787791027.803195:0:17144:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff916fc26a3c00:17144] 1 exiting: rc = 0 00000100:00100000:3.0:1787791027.803885:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803893:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803899:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803904:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803909:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803916:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803921:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803927:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803934:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803940:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803945:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803951:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803957:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803963:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803969:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803975:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803981:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803986:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803992:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.803998:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804004:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804009:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804015:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804020:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804026:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804032:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804038:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804043:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804048:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804053:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804059:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804065:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804071:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804094:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804100:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804105:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804111:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804117:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804123:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804129:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804136:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804142:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804148:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804154:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804160:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804166:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804171:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804176:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804181:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804187:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804192:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804198:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804204:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804210:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804214:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804220:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804226:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804232:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804237:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804243:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804250:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804255:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804260:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.804266:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.804903:0:17145:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9170e58b7c00:17145] 0 exiting: rc = 1 00000100:00100000:0.0:1787791027.805949:0:17146:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9170ceaa0000:17146] 1 exiting: rc = 0 00000100:00100000:3.0:1787791027.806119:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806128:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806134:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806139:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806163:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806169:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806174:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806179:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806186:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806192:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806197:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806203:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806209:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806214:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806221:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806226:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806233:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806239:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806245:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806251:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806257:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806263:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806268:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806274:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806281:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806286:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806292:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806299:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806305:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806310:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806314:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806331:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806338:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806343:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806349:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806354:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806359:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806364:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806369:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806382:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806389:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806395:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806401:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806406:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806413:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806419:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806425:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806430:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806437:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806442:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806448:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806453:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806459:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806465:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806471:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806478:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806484:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806491:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806496:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806502:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806509:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806515:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806531:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.806537:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787791027.807296:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff917101154200:17148] 1 exiting: rc = 0 00000100:00100000:0.0:1787791027.807813:0:17147:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff916fc3018a00:17147] 0 exiting: rc = 1 00000100:00100000:0.0:1787791027.808038:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9170ceaa0e00:17149] 2 exiting: rc = 0 00000100:00100000:3.0:1787791027.808269:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808279:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808285:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808292:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808298:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808304:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808340:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808347:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808355:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808363:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808388:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808395:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808402:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808410:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808416:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808422:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808429:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808435:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808441:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808447:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808453:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808458:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808464:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808469:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808475:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808481:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808488:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808494:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808500:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808506:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808534:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808541:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808546:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808554:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808561:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808567:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808573:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808579:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808586:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808593:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808600:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808606:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808613:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808619:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808625:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808636:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808642:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808648:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808655:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808670:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808677:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808937:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808944:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808950:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808973:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808980:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808987:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808993:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.808999:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.809005:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.809012:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.809017:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.809023:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791027.809029:0:20907:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787791027.817450:0:20907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791027.817470:0:20907:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787791027.817478:0:20907:0:(genops.c:885:class_export_put()) final put ffff9170facfa800/MDS_uuid 00000020:00000080:0.0:1787791027.817498:0:20907:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facfa800/MDS_uuid for MDS 00000020:01000000:0.0:1787791027.817505:0:20907:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787791027.818007:0:20907:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787791028.491614:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791029.516287:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787791030.091672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791030.091688:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791030.091692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791030.091697:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787791030.091739:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791030.091752:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 573 00000100:00080000:0.0:1787791030.091761:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787791030.091771:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff916fc1dd4800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791030.091823:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a55680 x1874634268169472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787791030.091900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791030.091905:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787791030.091906:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791030.091911:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 573 00000100:00080000:0.0:1787791030.091915:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787791030.091919:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc46a2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791030.091934:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a57c00 x1874634268169728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791030.091993:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268169472:0@lo:38:kworker.0 00000400:00000100:0.0:1787791030.092071:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268169472 offset 0 length 520: 4 00000100:00100000:0.0:1787791030.092115:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268169728:0@lo:38:kworker.0 00000400:00000100:0.0:1787791030.092151:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268169728 offset 0 length 520: 4 00000100:00100000:0.0:1787791030.092186:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268169600:0@lo:400:kworker.0 00000400:00000100:0.0:1787791030.092207:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268169600 offset 0 length 224: 4 00000100:00100000:0.0:1787791030.092222:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791030.092227:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268169856:0@lo:400:kworker.0 00000400:00000100:0.0:1787791030.092244:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268169856 offset 0 length 224: 4 00010000:00010000:0.0:1787791030.541006:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791031.563995:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787791031.864103:0:21110:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787791031.887403:0:21110:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787791031.887476:0:21110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791031.887502:0:21110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791031.887511:0:21110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791031.887519:0:21110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791031.887553:0:21110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787791031.887561:0:21110:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787791031.887595:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791031.887612:0:21110:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a55680 x1874634268169472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787791050 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787791031.887825:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791031.887834:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791031.887843:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791031.887846:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791031.887856:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791031.887864:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791031.887870:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787791031.887873:0:17122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787791031.887876:0:17122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787791031.887896:0:17122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:1.0:1787791031.887900:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791031.887907:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4538000/0xcf9477fddcf1ed6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ed75 expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791031.887920:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791031.887921:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791031.887923:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791031.889128:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787791031.889143:0:21110:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787791031.889220:0:21110:0:(import.c:65:import_set_state_nolock()) ffff916fc1dd4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787791031.889247:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787791031.889257:0:21110:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a55680 x1874634268169472/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787791050 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791031.889502:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787791031.889524:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268169472:0@lo:38:kworker.0 00000100:00100000:2.0:1787791031.889587:0:21110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787791031.891143:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787791031.891225:0:21110:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a56580 x1874634268169600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791031.891308:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787791031.891316:0:21110:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787791031.891348:0:21110:0:(import.c:65:import_set_state_nolock()) ffff9170e02d6800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787791031.891426:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268169984:0@lo:39:umount.0 00000400:00000100:1.0:1787791031.891508:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268169984 offset 0 length 224: 4 00000100:00100000:0.0:1787791031.891625:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268169600:0@lo:400:kworker.0 00000100:00080000:3.0:1787791032.139059:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787791032.139076:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791032.139080:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787791032.139085:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791032.139324:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787791032.139355:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268170112:0@lo:400:kworker.0 00000400:00000100:2.0:1787791032.139429:0:3641:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268170112 offset 0 length 224: 4 00010000:00010000:0.0:1787791032.587069:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787791033.165678:0:19455:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787791033.165690:0:19455:0:(genops.c:885:class_export_put()) final put ffff916fc46a7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787791033.165987:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787791033.166072:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a4800 for lustre-OST0001 00000001:00100000:2.0:1787791033.168513:0:18637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787791033.168528:0:18637:0:(genops.c:885:class_export_put()) final put ffff9170e02d6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787791033.168631:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9170e02d6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787791033.168695:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170e02d5000 for lustre-OST0000 00010000:00010000:0.0:1787791033.611787:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791034.635773:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791035.147629:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787791035.147645:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791035.147649:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787791035.147653:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787791035.147829:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787791035.147859:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268170240:0@lo:400:kworker.0 00000400:00000100:0.0:1787791035.147934:0:3640:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268170240 offset 0 length 224: 4 00010000:00010000:0.0:1787791035.659633:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791036.683231:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791037.002849:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791027/real 1787791027] req@ffff916fc3767480 x1874634268169344/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787791037 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791037.002886:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3767480 x1874634268169344/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787791037 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787791037.002907:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787791037.002980:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787791037.002985:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268169344:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1787791037.004683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791037.004694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1787791037.004698:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787791037.004732:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1787791037.004739:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787791037.004748:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170facf9800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791037.004812:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a56580 x1874634268170368/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787791037.004834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791037.004839:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791037.005006:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268170496:0@lo:400:kworker.0 00000400:00000100:2.0:1787791037.005060:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268170496 offset 0 length 224: 4 00000100:00100000:1.0:1787791037.005079:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268170368:0@lo:250:kworker.0 00000400:00000100:1.0:1787791037.005102:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268170368 offset 0 length 520: 4 00010000:00010000:1.0:1787791037.706894:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791038.733132:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791039.754946:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791040.779671:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791041.099045:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791031/real 1787791031] req@ffff916fc37652c0 x1874634268169984/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787791041 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791041.099076:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc37652c0 x1874634268169984/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787791041 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787791041.099095:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170e02d6800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787791041.099116:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268169984:0@lo:39:umount.0 00000100:00080000:2.0:1787791041.099201:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787791041.099206:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787791041.099211:0:21110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787791041.101191:0:21110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101210:0:21110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101219:0:21110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101226:0:21110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101304:0:21110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787791041.101313:0:21110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101320:0:21110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101325:0:21110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791041.101331:0:21110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104143:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791041.104157:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104168:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791041.104172:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104182:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791041.104189:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791041.104194:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787791041.104197:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787791041.104210:0:19471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:0.0:1787791041.104213:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104219:0:19471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4538e00/0xcf9477fddcf1ed44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ed4b expref: -99 pid: 18636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104256:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791041.104260:0:19471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104265:0:19471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791041.104269:0:19471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104275:0:19471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791041.104281:0:19471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791041.104287:0:19471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787791041.104289:0:19471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787791041.104293:0:19471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:0.0:1787791041.104295:0:19471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791041.104302:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791041.104303:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791041.104305:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791041.108770:0:21110:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787791041.108786:0:21110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f0a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1f0af expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791041.108808:0:21110:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787791041.108849:0:21110:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1787791041.108851:0:21110:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787791041.108891:0:21110:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787791041.108895:0:21110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787791041.108909:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787791041.108915:0:21110:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787791041.108919:0:21110:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff916fc45f99b8) has no exports 00000020:00080000:2.0:1787791041.108940:0:21110:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff916fc45f99b8) has no exports 00010000:00010000:0.0:1787791041.110772:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787791041.116029:0:21110:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1dd9900 - data ffff9170e1bad870/ffff9170fe1fd000 00000020:01000000:2.0:1787791041.116187:0:21110:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1dd9780 - data ffff9170d69b1000/ffff916fc3b8ac00 00100000:10000000:2.0:1787791041.126133:0:21110:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787791041.142866:0:21110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed59 00000020:00000080:0.0:1787791041.142887:0:21110:0:(genops.c:885:class_export_put()) final put ffff916fc3938000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787791041.142913:0:21110:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f67ce800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787791041.142918:0:21110:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67ce800 2 00000020:01000004:0.0:1787791041.142921:0:21110:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170f67ce800 from lustre-OST0000 00000020:00000080:0.0:1787791041.142988:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791041.143004:0:21110:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787791041.143008:0:21110:0:(genops.c:885:class_export_put()) final put ffff916fc393c000/lustre-OST0000_UUID 00000020:00000080:0.0:1787791041.143011:0:21110:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc393c000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787791041.143019:0:21110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787791041.143108:0:21110:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787791041.143114:0:21110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787791041.143118:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791041.143125:0:21110:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787791041.143132:0:21110:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9170e02d3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791041.143139:0:21110:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff916fc45f8000) has exports, disconnecting them 00000020:00080000:0.0:1787791041.143146:0:21110:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9170e02d3000), last request at 1787790961 00000020:00000080:0.0:1787791041.143151:0:21110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed83 00000020:00080000:0.0:1787791041.143163:0:21110:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9170e02d3000): rc 0 00000020:00000080:0.0:1787791041.143169:0:21110:0:(genops.c:885:class_export_put()) final put ffff9170e02d3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787791041.143532:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3938000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787791041.143562:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170e02d3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787791041.144807:0:21110:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787791041.144817:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787791041.144823:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787791041.144832:0:21110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787791041.144971:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc1dd4800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787791041.145099:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787791041.145110:0:21110:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787791041.145116:0:21110:0:(genops.c:885:class_export_put()) final put ffff916fc3939000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787791041.145121:0:21110:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3939000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787791041.145133:0:21110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787791041.145213:0:21110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787791041.145217:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787791041.145222:0:21110:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787791041.145229:0:21110:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff916fc3933000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787791041.145235:0:21110:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9170d63819b8) has exports, disconnecting them 00000020:00080000:1.0:1787791041.145240:0:21110:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff916fc3933000), last request at 1787790961 00000020:00000080:1.0:1787791041.145244:0:21110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed98 00000020:00080000:1.0:1787791041.145263:0:21110:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc3933000): rc 0 00000020:00000080:1.0:1787791041.145267:0:21110:0:(genops.c:885:class_export_put()) final put ffff916fc3933000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787791041.145314:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc3933000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1787791041.166906:0:21110:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787791041.166919:0:21110:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787791041.166924:0:21110:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787791041.166934:0:21110:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787791041.167201:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787791041.167211:0:21110:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1787791041.167220:0:21110:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f67ce800 1 00000020:00000080:1.0:1787791041.167229:0:21110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ed36 00000020:00000080:1.0:1787791041.167240:0:21110:0:(genops.c:885:class_export_put()) final put ffff9170f503a800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787791041.167247:0:21110:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787791041.167256:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787791041.167261:0:21110:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787791041.167265:0:21110:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9170facf19b8) has no exports 00000020:00000080:3.0:1787791041.169872:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170e02d6800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787791041.169907:0:15159:0:(genops.c:885:class_export_put()) final put ffff9170e02d4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787791041.169911:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170e02d4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787791041.169929:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787791041.170018:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787791041.320146:0:21110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787791041.320166:0:21110:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1787791041.320173:0:21110:0:(genops.c:885:class_export_put()) final put ffff9170f67cd000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1787791041.320180:0:21110:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f67cd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1787791041.320198:0:21110:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1787791041.320362:0:21110:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170f67cb000 00000020:02000400:3.0:1787791041.320444:0:21110:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787791041.803018:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787791042.379172:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791042.379183:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791042.379187:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787791042.379190:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787791042.379250:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791042.379268:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268170624:0@lo:400:kworker.0 00000400:00000100:0.0:1787791042.379321:0:3638:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268170624 offset 0 length 224: 4 00010000:00010000:0.0:1787791042.827000:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791043.853470:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787791044.716637:0:21313:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787791044.729894:0:21313:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787791044.729978:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791044.729990:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791044.729996:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791044.730000:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791044.730015:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787791044.730020:0:21313:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787791044.730039:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787791044.730052:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a57c00 x1874634268169728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787791050 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.730096:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787791044.730104:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787791044.730111:0:21313:0:(import.c:65:import_set_state_nolock()) ffff916fc46a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787791044.730116:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787791044.730121:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a57c00 x1874634268169728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787791050 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.730127:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787791044.730131:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1787791044.730192:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268169728:0@lo:38:kworker.0 00010000:00010000:1.0:1787791044.730250:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791044.730259:0:17122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791044.730274:0:17122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791044.730278:0:17122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791044.730288:0:17122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791044.730296:0:17122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791044.730301:0:17122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787791044.730303:0:17122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787791044.730305:0:17122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787791044.730327:0:17122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:1.0:1787791044.730332:0:17122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791044.730339:0:17122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1ee08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ee0f expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791044.730351:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791044.730357:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791044.730359:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787791044.732343:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787791044.732362:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a561c0 x1874634268169856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.732402:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9170e47f4b40 x1874634268170112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791048 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.732421:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc37643c0 x1874634268170240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.732443:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a55680 x1874634268170496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791053 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.732451:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3a57840 x1874634268170624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791058 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791044.732458:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787791044.732464:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1787791044.732469:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268170496:0@lo:400:kworker.0 00000100:00080000:3.0:1787791044.732490:0:21313:0:(import.c:65:import_set_state_nolock()) ffff916fc46a6000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787791044.732494:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268169856:0@lo:400:kworker.0 00000100:00100000:3.0:1787791044.732524:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268170752:0@lo:39:umount.0 00000100:00100000:0.0:1787791044.732531:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268170624:0@lo:400:kworker.0 00000400:00000100:3.0:1787791044.732573:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874634268170752 offset 0 length 224: 4 00000100:00100000:2.0:1787791044.732606:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268170112:0@lo:400:kworker.0 00000100:00100000:1.0:1787791044.732882:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268170240:0@lo:400:kworker.0 00010000:00010000:0.0:1787791044.876010:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791045.900920:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791046.922976:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787791047.498956:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787791047.498981:0:15159:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787791047.947562:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791048.971453:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791050.000547:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791051.020265:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791052.042983:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791052.618968:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787791052.618979:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787791052.939151:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791037/real 1787791037] req@ffff916fc3a56580 x1874634268170368/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787791052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791052.939185:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3a56580 x1874634268170368/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787791052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787791052.939205:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791052.939238:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787791052.939243:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268170368:0@lo:250:kworker.0 00000100:00080000:1.0:1787791052.939398:0:15159:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787791052.939403:0:15159:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787791052.939427:0:15159:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791052.939432:0:15159:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 585 00000100:00080000:1.0:1787791052.939438:0:15159:0:(import.c:589:import_select_connection()) MGC192.168.202.122@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787791052.939444:0:15159:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff9170facf9800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791052.939473:0:15159:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b92940 x1874634268170880/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791052.939620:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268170880:0@lo:250:kworker.0 00000400:00000100:3.0:1787791052.939668:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874634268170880 offset 0 length 520: 4 00010000:00010000:1.0:1787791053.067979:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791054.091420:0:19471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791054.986843:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791044/real 1787791044] req@ffff9170e47f61c0 x1874634268170752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787791054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791054.986880:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170e47f61c0 x1874634268170752/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787791054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787791054.986901:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc46a6000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787791054.986919:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268170752:0@lo:39:umount.0 00000100:00080000:0.0:1787791054.987064:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787791054.987070:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787791054.987075:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787791054.988270:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988301:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988310:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988318:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988392:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791054.988402:0:21313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988408:0:21313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988431:0:21313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791054.988437:0:21313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997558:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787791054.997584:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997597:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791054.997603:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997614:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791054.997622:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791054.997627:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787791054.997630:0:17123:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787791054.997645:0:17123:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:1.0:1787791054.997649:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997656:0:17123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4539a00/0xcf9477fddcf1edde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ede5 expref: -99 pid: 19454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997697:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791054.997702:0:17123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997749:0:17123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791054.997752:0:17123:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997760:0:17123:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791054.997766:0:17123:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791054.997771:0:17123:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787791054.997774:0:17123:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787791054.997778:0:17123:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:1.0:1787791054.997781:0:17123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791054.997789:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791054.997790:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791054.997792:0:17123:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791055.003219:0:21313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791055.003236:0:21313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc4539600/0xcf9477fddcf1f09a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1f0a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791055.003263:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787791055.003271:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787791055.003274:0:21313:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787791055.003320:0:21313:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787791055.003324:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787791055.003336:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791055.003343:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787791055.003348:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9170d6380000) has no exports 00000020:00080000:0.0:1787791055.003376:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9170d6380000) has no exports 00010000:00010000:1.0:1787791055.003476:0:17122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787791055.005208:0:21313:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc1dd9d80 - data ffff9170d69c1ca8/ffff9170fc8a5000 00000020:01000000:0.0:1787791055.005341:0:21313:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff916fc32e8b40 - data ffff9170d6890510/ffff9170f39b9c00 00100000:10000000:1.0:1787791055.024021:0:21313:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787791055.038736:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1edf3 00000020:00000080:3.0:1787791055.038752:0:21313:0:(genops.c:885:class_export_put()) final put ffff9170f3de1000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787791055.038769:0:21313:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170e02d7800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787791055.038772:0:21313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170e02d7800 2 00000020:01000004:3.0:1787791055.038776:0:21313:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9170e02d7800 from lustre-OST0001 00000020:00000080:3.0:1787791055.038803:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787791055.038814:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787791055.038818:0:21313:0:(genops.c:885:class_export_put()) final put ffff9170f3de4800/lustre-OST0001_UUID 00000020:00000080:3.0:1787791055.038834:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3de4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787791055.038841:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787791055.038952:0:21313:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5041f1dd-aadb-4baa-80c4-90de68fcfbb8->MGS 00010000:00010000:3.0:1787791055.038969:0:21313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791055.038981:0:21313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791055.038987:0:21313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787791055.038990:0:21313:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787791055.038993:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787791055.039007:0:21313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:3.0:1787791055.039011:0:21313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1ec02 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1ec09 expref: -99 pid: 17866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791055.039025:0:21313:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787791055.039032:0:21313:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791055.039037:0:21313:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787791055.039039:0:21313:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787791055.039041:0:21313:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787791055.039050:0:21313:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9170facf9800 00010000:00010000:3.0:1787791055.039054:0:21313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc3994800/0xcf9477fddcf1eaf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf9477fddcf1eaf8 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787791055.039070:0:21313:0:(import.c:65:import_set_state_nolock()) ffff9170facf9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787791055.039074:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787791055.039083:0:21313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787791055.039085:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787791055.039088:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787791055.039098:0:21313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff916fc3b92940 x1874634268170880/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787791072 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787791055.039123:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787791055.039126:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:1.0:1787791055.039191:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3de1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1787791055.039272:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5041f1dd-aadb-4baa-80c4-90de68fcfbb8:3637:1874634268170880:0@lo:250:kworker.0 10000000:01000000:3.0:1787791055.039354:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787791055.039362:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1eadc 00000020:00000080:3.0:1787791055.039366:0:21313:0:(genops.c:885:class_export_put()) final put ffff9170facff800/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 00000020:01000000:3.0:1787791055.039409:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.122@tcp (flags='') 00000020:00000080:3.0:1787791055.039415:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787791055.039420:0:21313:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787791055.039424:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9170fc134d28) has no exports 00000020:00000080:1.0:1787791055.040624:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facff800/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 for MGC192.168.202.122@tcp 10000000:01000000:0.0:1787791055.040698:0:17131:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787791055.040857:0:21313:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.122@tcp: client import never connected 00000100:00080000:3.0:1787791055.040862:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787791055.040865:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787791055.040868:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787791055.040871:0:21313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787791055.040925:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787791055.040933:0:21313:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.122@tcp (uuid 5041f1dd-aadb-4baa-80c4-90de68fcfbb8) 00000020:01000000:3.0:1787791055.040941:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787791055.040946:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787791055.040950:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787791055.040958:0:21313:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff916fc46a3800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787791055.040963:0:21313:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9170d6384d28) has exports, disconnecting them 00000020:00080000:3.0:1787791055.040967:0:21313:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff916fc46a3800), last request at 1787790976 00000020:00000080:3.0:1787791055.040971:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee1d 00000020:00080000:3.0:1787791055.040984:0:21313:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc46a3800): rc 0 00000020:00000080:3.0:1787791055.040989:0:21313:0:(genops.c:885:class_export_put()) final put ffff916fc46a3800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787791055.041475:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9170facf9800 for MGC192.168.202.122@tcp 00000020:00000080:1.0:1787791055.041497:0:15159:0:(genops.c:885:class_export_put()) final put ffff9170facf8000/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 00000020:00000080:1.0:1787791055.041499:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170facf8000/5041f1dd-aadb-4baa-80c4-90de68fcfbb8 for MGC192.168.202.122@tcp 00000020:01000000:1.0:1787791055.041504:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.122@tcp (5041f1dd-aadb-4baa-80c4-90de68fcfbb8) 00000020:00000080:1.0:1787791055.041794:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a3800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787791055.043846:0:21313:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787791055.043855:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787791055.043860:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787791055.043868:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787791055.044064:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791055.044083:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787791055.044090:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787791055.044094:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791055.044099:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787791055.044106:0:21313:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff916fc46a7000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787791055.044111:0:21313:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9170eef319b8) has exports, disconnecting them 00000020:00080000:0.0:1787791055.044115:0:21313:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff916fc46a7000), last request at 1787790976 00000020:00000080:0.0:1787791055.044118:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1ee32 00000020:00080000:0.0:1787791055.044133:0:21313:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff916fc46a7000): rc 0 00000020:00000080:0.0:1787791055.044137:0:21313:0:(genops.c:885:class_export_put()) final put ffff916fc46a7000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1787791055.044769:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a2000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787791055.044776:0:15159:0:(genops.c:885:class_export_put()) final put ffff9170f3de4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787791055.044779:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f3de4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787791055.044785:0:15159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787791055.044843:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a7000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1787791055.079635:0:21313:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787791055.079647:0:21313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787791055.079651:0:21313:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787791055.079659:0:21313:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787791055.079701:0:15159:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff916fc46a6000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1787791055.079978:0:19471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787791055.080204:0:17123:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787791055.080305:0:17122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1787791055.093895:0:17117:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9170fc215200:17117] 0 exiting: rc = 1 00000100:00100000:3.0:1787791055.114807:0:17118:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9170df10d000:17118] 1 exiting: rc = 0 00000100:00100000:1.0:1787791055.115055:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.115331:0:20908:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff916fc3479c00:20908] 3 exiting: rc = 0 00000100:00100000:1.0:1787791055.115490:0:17120:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9170df10d400:17120] 1 exiting: rc = 0 00000100:00100000:1.0:1787791055.115555:0:20909:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff916fc3183000:20909] 4 exiting: rc = 0 00000100:00100000:2.0:1787791055.118951:0:17121:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9170df10c800:17121] 2 exiting: rc = 0 00000100:00100000:3.0:1787791055.125006:0:17119:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9170df10d800:17119] 0 exiting: rc = 1 00000100:00100000:1.0:1787791055.125511:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125525:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125532:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125539:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125545:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125552:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125558:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125564:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125569:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125582:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125587:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125593:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125599:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125604:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125609:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125615:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125619:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125624:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125629:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125635:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125641:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125646:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125651:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125656:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125662:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125667:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125674:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125679:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125685:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125689:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125695:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125700:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125737:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125744:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125750:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125755:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125760:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125765:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125770:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125775:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125780:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125785:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125790:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125795:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125810:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125815:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125821:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125826:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125831:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125839:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125844:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125849:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125854:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125858:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125863:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125868:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125874:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125878:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125883:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125888:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125894:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125899:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125904:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.125910:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787791055.126835:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787791055.126847:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787791055.126854:0:21313:0:(genops.c:885:class_export_put()) final put ffff916fc46a6800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787791055.126858:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc46a6800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787791055.126864:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787791055.126917:0:21313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170e02d7800 1 00000020:00000080:3.0:1787791055.126924:0:21313:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcf9477fddcf1edd7 00000020:00000080:3.0:1787791055.126930:0:21313:0:(genops.c:885:class_export_put()) final put ffff916fc36b0000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787791055.126940:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787791055.126944:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787791055.126949:0:21313:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787791055.126953:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9170eef519b8) has no exports 00000020:00000080:1.0:1787791055.129553:0:15159:0:(genops.c:844:class_export_destroy()) destroying export ffff916fc36b0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787791055.177589:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791055.177605:0:21313:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787791055.177611:0:21313:0:(genops.c:885:class_export_put()) final put ffff9170d6153800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787791055.177616:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff9170d6153800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787791055.177630:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787791055.178034:0:21313:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9170d6155000 00000020:01000000:0.0:1787791055.178055:0:21313:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787791055.178059:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787791055.178063:0:21313:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787791055.178066:0:21313:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9170eef53370) has no exports 00000020:00000080:0.0:1787791055.178091:0:21313:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787791055.178095:0:21313:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787791055.178098:0:21313:0:(genops.c:885:class_export_put()) final put ffff9170f503e000/OSS_uuid 00000020:00000080:0.0:1787791055.178100:0:21313:0:(genops.c:844:class_export_destroy()) destroying export ffff9170f503e000/OSS_uuid for OSS 00000020:01000000:0.0:1787791055.178104:0:21313:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787791055.178182:0:17130:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787791055.178208:0:18640:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91710119ca00:18640] 0 exiting: rc = 1 00000100:00100000:1.0:1787791055.178566:0:19281:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff916fc1ce6e00:19281] 3 exiting: rc = 0 00000100:00100000:3.0:1787791055.179537:0:19573:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff916fc4577600:19573] 4 exiting: rc = 0 00000100:00100000:2.0:1787791055.179600:0:18643:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9170fe383200:18643] 2 exiting: rc = 0 00000100:00100000:3.0:1787791055.179856:0:18642:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff916fc26a1200:18642] 1 exiting: rc = 0 00000100:00100000:1.0:1787791055.197787:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197801:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197806:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197811:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197816:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197821:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197827:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197834:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197839:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197844:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197849:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197854:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197858:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197878:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197883:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197888:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197894:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197899:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197904:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197908:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197914:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197919:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197924:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197929:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197933:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197938:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197942:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197947:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197951:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197956:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197961:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197967:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197971:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197976:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197981:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197985:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197990:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197994:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.197999:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198003:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198008:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198012:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198017:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198021:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198026:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198032:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198036:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198040:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198056:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198062:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198067:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198072:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198077:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198082:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198087:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198092:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198098:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198103:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198111:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198116:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198121:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198126:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198130:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.198135:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787791055.203800:0:18644:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9170f5b41000:18644] 0 exiting: rc = 1 00000100:00100000:0.0:1787791055.207130:0:18645:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9170f5b40200:18645] 1 exiting: rc = 0 00000100:00100000:1.0:1787791055.209580:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209592:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209599:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209607:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209615:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209621:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209627:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209645:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209652:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209658:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209663:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209669:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209680:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209688:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209698:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209729:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209736:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209742:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209753:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209776:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209782:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209787:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209792:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209798:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209804:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209809:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209814:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209819:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209824:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209829:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209835:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209842:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209848:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209853:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209859:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209864:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209869:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209875:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209880:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209885:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209890:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209895:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209901:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209907:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209912:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209917:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209922:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209928:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209938:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209945:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209951:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209957:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209963:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209968:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209979:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209985:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.209991:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210005:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210012:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210017:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210023:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210029:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210034:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.210041:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.217754:0:18648:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9170fc575c00:18648] 2 exiting: rc = 0 00000100:00100000:3.0:1787791055.219111:0:18647:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9170fc575400:18647] 1 exiting: rc = 0 00000100:00100000:3.0:1787791055.219352:0:18646:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9170e5a9b000:18646] 0 exiting: rc = 1 00000100:00100000:3.0:1787791055.221572:0:20275:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9170fe0a3200:20275] 3 exiting: rc = 0 00000100:00100000:1.0:1787791055.229161:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229180:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229188:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229195:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229211:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229220:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229228:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229234:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229241:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229247:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229255:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229262:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229269:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229290:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229296:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229303:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229309:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229315:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229322:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229330:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229336:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229342:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229348:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.229354:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230165:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230172:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230179:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230185:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230191:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230220:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230227:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230233:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230239:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230245:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230252:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230258:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230264:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230271:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230290:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230297:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230304:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230310:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230317:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230323:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230330:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230337:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230343:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230349:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230356:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230794:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230800:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230807:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230815:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230841:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230850:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230862:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230868:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230874:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230880:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230895:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230902:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230908:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230915:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787791055.230923:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.240032:0:18649:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9170fc575000:18649] 0 exiting: rc = 1 00000100:00100000:2.0:1787791055.249166:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9170fc574a00:18650] 1 exiting: rc = 0 00000100:00100000:3.0:1787791055.249645:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249672:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249695:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249730:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249739:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249747:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249765:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249791:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249812:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249838:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249858:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249883:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249908:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249945:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249963:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249983:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249988:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.249994:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250014:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250037:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250062:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250086:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250114:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250135:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250157:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250182:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250204:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250227:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250254:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250290:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250314:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250336:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250357:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250380:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250405:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250474:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250494:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250517:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250539:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250563:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250590:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250616:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250641:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250662:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250684:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250749:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250770:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250794:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250831:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250856:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250880:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250904:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250924:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250950:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250969:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.250991:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251017:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251040:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251067:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251089:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251111:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251137:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251160:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.251187:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.252826:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9170f5aff200:18652] 1 exiting: rc = 0 00000100:00100000:3.0:1787791055.252928:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9170fc574000:18651] 0 exiting: rc = 1 00000100:00100000:3.0:1787791055.252991:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.252998:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253010:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253017:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253023:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253029:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253034:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253051:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253059:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253064:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253070:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253077:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253090:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253097:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253107:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253115:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253123:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253145:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253151:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253187:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253197:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253204:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253210:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253217:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253230:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253237:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253243:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253251:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253261:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253284:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253293:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253314:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253322:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253328:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253334:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253340:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253347:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253353:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253360:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253366:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.253373:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254739:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254756:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254783:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254791:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254797:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254803:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254809:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254815:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254820:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254826:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254831:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254851:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254856:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254862:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254883:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254890:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254896:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254902:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254909:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254915:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254921:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254927:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787791055.254941:0:21313:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787791055.288524:0:21313:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787791076.442610:0:22078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787791087.276941:0:22679:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787791087.276948:0:22679:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787791087.276950:0:22679:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787791087.277068:0:22679:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170f39e2000 00000020:01000004:2.0:1787791087.277086:0:22679:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787791087.277095:0:22679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787791087.277110:0:22679:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9170facf0000) 00000020:00000080:2.0:1787791087.277123:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787791087.386001:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.389064:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787791087.390595:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.390844:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.391114:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.391690:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.392061:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.392407:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.392593:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.392853:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.393092:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.393542:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.393770:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.393963:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.394288:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.394580:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.397819:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.398461:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.398675:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.398900:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.399204:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.400273:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.400599:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.401276:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.401569:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.401845:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.402312:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.403566:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.403811:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.404009:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.404419:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.404673:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787791087.405208:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.407444:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787791087.415270:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787791087.420027:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787791087.421040:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1787791087.421261:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1787791087.421462:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1787791087.421641:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787791087.429518:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.430052:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787791087.430448:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.430656:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.430878:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787791087.431084:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.431658:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.433262:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.434503:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.434845:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.435490:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.435859:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787791087.436065:0:22679:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787791087.436831:0:22679:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787791087.437059:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787791087.437067:0:22679:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787791087.437079:0:22679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f34f 00000020:01000004:3.0:1787791087.437095:0:22679:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787791087.437099:0:22679:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787791087.437104:0:22679:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f39e2000 from MGS 00000020:01000004:3.0:1787791087.437108:0:22679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787791087.437119:0:22679:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9170eef53370) 00000020:00000080:3.0:1787791087.437142:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787791087.444678:0:22679:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f39e2000 from MGS, refs=2 00080000:01000000:1.0:1787791087.444695:0:22679:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787791087.444763:0:22679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f35d 00000100:00100000:1.0:1787791087.444913:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787791087.445060:0:22679:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787791087.445067:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787791087.450982:0:22679:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787791087.451012:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787791087.452247:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791087.452431:0:22679:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787791087.452436:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787791087.454750:0:22679:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787791087.454762:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787791087.464825:0:22679:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787791087.464842:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787791087.471420:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.471427:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.471429:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.480472:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.480479:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.480482:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791087.484217:0:22679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787791087.486770:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787791087.501285:0:22679:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1787791087.503670:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787791087.503722:0:22679:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787791087.503779:0:22679:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787791087.504448:0:22679:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787791087.504803:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791087.504976:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787791087.504982:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787791087.505679:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787791087.505689:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787791087.509785:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787791087.509799:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787791087.510623:0:22696:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787791087.510697:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787791087.510752:0:22679:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.122@tcp' 00000020:01000004:0.0:1787791087.510754:0:22679:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787791087.510786:0:22679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.122@tcp (typ=mgc) 00000020:00000080:0.0:1787791087.510799:0:22679:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.122@tcp (ffff916fc45f99b8) 00000020:00000080:0.0:1787791087.510817:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787791087.510895:0:22679:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc344e000@MGC192.168.202.122@tcp: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787791087.511055:0:22679:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.122@tcp-0 is initialized 00000040:01000000:0.0:1787791087.511061:0:22679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787791087.513247:0:22697:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787791087.513680:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.122@tcp (uuid fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3) 00000020:00000080:0.0:1787791087.513724:0:22679:0:(genops.c:1385:class_connect()) connect: client fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3, cookie 0xcf9477fddcf1f36b 00000100:00080000:0.0:1787791087.513738:0:22679:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787791087.513744:0:22679:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff916fc344e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791087.513778:0:22679:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a543c0 x1874634268171008/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791087.513829:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3637:1874634268171008:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787791087.513900:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.513977:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171008 00000100:00100000:0.0:1787791087.514000:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171008 00000100:00100000:0.0:1787791087.514034:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787791087.514041:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1874634268171008:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787791087.514071:0:22693:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:0.0:1787791087.514094:0:22693:0:(genops.c:1385:class_connect()) connect: client fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3, cookie 0xcf9477fddcf1f372 00000100:00080000:0.0:1787791087.514239:0:22693:0:(import.c:65:import_set_state_nolock()) ffff916fc344f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791087.514289:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:3637:x1874634268171008:12345-0@lo:250:mount.lustre.0 Request processed in 247us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791087.514296:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787791087.514338:0:3637:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787791087.514345:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787791087.514352:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787791087.514355:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787791087.514359:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc344e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787791087.514361:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787791087.514369:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787791087.514374:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3637:1874634268171008:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1787791087.514392:0:22679:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3->MGS 00000020:01000004:0.0:1787791087.514410:0:22679:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787791087.514415:0:22679:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787791087.514428:0:22679:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff916fc45fcd28) 00000020:00000080:0.0:1787791087.514439:0:22679:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787791087.534414:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787791087.534961:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787791087.534968:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787791087.535947:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787791087.535956:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787791087.536357:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787791087.536365:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787791087.541076:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787791087.541280:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787791087.541287:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787791087.541929:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787791087.541937:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787791087.573435:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787791087.576076:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787791087.576098:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787791087.577396:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787791087.577403:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787791087.578970:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787791087.579232:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787791087.579238:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787791087.580121:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787791087.580197:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787791087.581316:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791087.582063:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787791087.582070:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787791087.582889:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787791087.582898:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787791087.583300:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791087.583434:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787791087.583437:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787791087.584847:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787791087.584858:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787791087.607313:0:22679:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791087.607525:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787791087.607532:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787791087.611297:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787791087.611316:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787791087.612229:0:22679:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787791087.612315:0:22679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787791087.613060:0:22679:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787791087.613087:0:22679:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1787791087.613094:0:22679:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787791087.613199:0:22679:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787791087.613239:0:22679:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787791087.613243:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787791087.613244:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787791087.613246:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791087.613247:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791087.613248:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791087.613249:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791087.613251:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787791087.613252:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787791087.613254:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791087.613255:0:22679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791087.613257:0:22679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787791087.613259:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787791087.613261:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787791087.613262:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791087.613264:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791087.613264:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791087.613265:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791087.613267:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787791087.613267:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787791087.613269:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791087.613270:0:22679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791087.613296:0:22679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787791087.613318:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171136:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787791087.613391:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.613482:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e10f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.613535:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171136 00000100:00100000:1.0:1787791087.613542:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171136 00000100:00100000:1.0:1787791087.613619:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791087.613630:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:22679:x1874634268171136:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787791087.613672:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787791087.613675:0:22695:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787791087.613678:0:22695:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787791087.613969:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787791087.615406:0:22695:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787791087.617820:0:22717:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787791087.617831:0:22717:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787791087.617834:0:22717:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787791087.617837:0:22717:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787791087.618017:0:22717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1787791087.618322:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787791087.618335:0:22695:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787791087.623744:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:22679:x1874634268171136:12345-0@lo:253:mount.lustre.0 Request processed in 10106us (10341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791087.623759:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791087.623875:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a543c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171136:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787791087.623891:0:22679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787791087.623894:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787791087.623896:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787791087.623897:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791087.623898:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791087.623899:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791087.623912:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791087.623913:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787791087.623914:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787791087.623916:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791087.623917:0:22679:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787791087.623938:0:22679:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f39e2000 from lustre-MDT0000 10000000:01000000:1.0:1787791087.623968:0:22679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787791087.623971:0:22679:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787791087.623976:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff916fc45f99b8 10000000:01000000:1.0:1787791087.623980:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787791087.623998:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff916fc45f99b8 from 1 10000000:01000000:1.0:1787791087.624001:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787791087.624040:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.624050:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.624060:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.624080:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787791087.624117:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.624301:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65000 going to sleep for 11 seconds 00000100:00100000:0.0:1787791087.624344:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171264 00000100:00100000:0.0:1787791087.624350:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171264 00000100:00100000:0.0:1787791087.624421:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791087.624431:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:22679:x1874634268171264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791087.624445:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791087.624461:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f380 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.624485:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f380 expref: 6 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.624497:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165e800/0xcf9477fddcf1f387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f380 expref: 6 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.624507:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165e800, rc 0) 00000100:00100000:0.0:1787791087.624975:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:22679:x1874634268171264:12345-0@lo:101:mount.lustre.0 Request processed in 543us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.625088:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791087.625105:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.625115:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791087.625215:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791087.625246:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.625268:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787791087.625484:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76000 going to sleep for 11 seconds 00000100:00100000:0.0:1787791087.625663:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171392 00000100:00100000:0.0:1787791087.625668:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171392 00000100:00100000:0.0:1787791087.625689:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787791087.625729:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:22679:x1874634268171392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791087.625814:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:22679:x1874634268171392:12345-0@lo:501:mount.lustre.0 Request processed in 111us (567us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787791087.625821:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787791087.625904:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171392:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787791087.625935:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787791087.626000:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.626019:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791087.626028:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f39e2000 10000000:01000000:2.0:1787791087.626032:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787791087.626036:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9170f39e2000 10000000:01000000:2.0:1787791087.626038:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787791087.626041:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9170f39e2000 from 1 10000000:01000000:2.0:1787791087.626044:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787791087.626070:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.626077:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.626085:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791087.626098:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787791087.626125:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791087.626267:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76000 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.626668:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171520 00000100:00100000:1.0:1787791087.626674:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171520 00000100:00100000:1.0:1787791087.626729:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787791087.626748:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:22679:x1874634268171520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.626757:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791087.626772:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d4800/0xcf9477fddcf1f395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f38e expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.626804:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d4800/0xcf9477fddcf1f395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f38e expref: 7 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.626815:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d4800/0xcf9477fddcf1f395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f38e expref: 7 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.626822:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4800, rc 0) 00000100:00100000:1.0:1787791087.626863:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+7:22679:x1874634268171520:12345-0@lo:101:mount.lustre.0 Request processed in 126us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.626869:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787791087.626970:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791087.626997:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f395 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.627006:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f395 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791087.627029:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787791087.627673:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f395 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.627684:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d3c00/0xcf9477fddcf1f38e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f395 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791087.627692:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787791087.627698:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787791087.627726:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9170f39e2000 10000000:01000000:2.0:1787791087.627731:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787791087.627735:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787791087.627737:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787791087.627759:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.627766:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.627773:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791087.627790:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787791087.627829:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791087.627857:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d0b76000 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.627930:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171648 00000100:00100000:1.0:1787791087.627934:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171648 00000100:00100000:1.0:1787791087.627964:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787791087.627971:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+7:22679:x1874634268171648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.627979:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791087.627997:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d5e00/0xcf9477fddcf1f3a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f39c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.628013:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d5e00/0xcf9477fddcf1f3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f39c expref: 8 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.628022:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d5e00/0xcf9477fddcf1f3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f39c expref: 8 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.628030:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5e00, rc 0) 00000100:00100000:1.0:1787791087.628072:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+8:22679:x1874634268171648:12345-0@lo:101:mount.lustre.0 Request processed in 101us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.628078:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787791087.628310:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791087.628324:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f3a3 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.628333:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f3a3 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791087.628403:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791087.628432:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.629023:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39ef0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.629127:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171776 00000100:00100000:2.0:1787791087.629248:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171776 00000100:00100000:2.0:1787791087.629322:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787791087.629340:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+8:22679:x1874634268171776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791087.629948:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22679:x1874634268171776:12345-0@lo:501:mount.lustre.0 Request processed in 608us (1514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.629957:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787791087.630084:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791087.630488:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791087.630614:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.630685:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39ef0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.630808:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268171904 00000100:00100000:2.0:1787791087.630814:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268171904 00000100:00100000:2.0:1787791087.630851:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787791087.630860:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22679:x1874634268171904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787791087.632292:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22679:x1874634268171904:12345-0@lo:503:mount.lustre.0 Request processed in 1426us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.632304:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787791087.632414:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268171904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791087.632958:0:22718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22718:1874634268172032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787791087.633016:0:22718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.633051:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.633141:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172032 00000100:00100000:2.0:1787791087.633148:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172032 00000100:00100000:2.0:1787791087.633329:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787791087.633340:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22718:x1874634268172032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787791087.634268:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22718:x1874634268172032:12345-0@lo:502:llog_process_th.0 Request processed in 925us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.634277:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787791087.634610:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22718:1874634268172032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787791087.634644:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791087.634656:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.634658:0:22718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787791087.634664:0:22718:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787791087.634667:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787791087.634682:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9170eef34d28) 00000020:00000080:1.0:1787791087.634699:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787791087.634817:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787791087.634912:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787791087.634920:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f3b1 00000020:00000080:1.0:1787791087.635259:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787791087.635264:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791087.635268:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.635270:0:22718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787791087.635273:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791087.635277:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.635278:0:22718:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787791087.635281:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787791087.635289:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9170eef33370) 00000020:00000080:1.0:1787791087.635298:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787791087.635302:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787791087.635303:0:22718:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787791087.635306:0:22718:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787791087.635312:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787791087.635356:0:22718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f39e2000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787791087.635369:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9170eef30000) 00000020:00000080:1.0:1787791087.635376:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787791087.635440:0:22718:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787791087.635449:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f3c6 00000020:00000080:1.0:1787791087.635686:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787791087.635693:0:22718:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787791087.635697:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf9477fddcf1f3cd 00080000:01000000:1.0:1787791087.635772:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787791087.635779:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f3d4 00010000:00010000:0.0:1787791087.764267:0:22718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787791087.764978:0:22718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:0.0:1787791087.765408:0:22718:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787791087.768498:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff916fc45fb370) 00000020:00000080:0.0:1787791087.768526:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787791087.769055:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787791087.769064:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f3e2 00000020:00000080:2.0:1787791087.777270:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787791087.799161:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf9477fddcf1f3e9 00000020:00000080:0.0:1787791087.799603:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787791087.799615:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791087.799759:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.799763:0:22718:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787791087.799768:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787791087.799770:0:22718:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787791087.799772:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787791087.799773:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787791087.799775:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787791087.799778:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.799780:0:22718:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787791087.799782:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791087.799787:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.799788:0:22718:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787791087.799792:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787791087.799829:0:22718:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787791087.799842:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791087.799845:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.799846:0:22718:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787791087.799856:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791087.799859:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.799860:0:22718:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787791087.799863:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787791087.799869:0:22718:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:0.0:1787791087.799892:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787791087.799909:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff916fc45f8000) 00000020:00000080:0.0:1787791087.799923:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787791087.799927:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787791087.799973:0:22718:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787791087.799978:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787791087.799993:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f3f7 00010000:00080000:0.0:1787791087.800022:0:22718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc393a800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787791087.805163:0:22718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787791087.813299:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787791087.813315:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787791087.813356:0:22718:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787791087.813376:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f3fe 00000100:00080000:3.0:1787791087.813392:0:22718:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787791087.813397:0:22718:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff916fc393a800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791087.813438:0:22718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e47f6940 x1874634268172160/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787791087.813466:0:22718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787791087.814856:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791087.814864:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.814866:0:22718:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787791087.814870:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787791087.814873:0:22718:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1787791087.814874:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787791087.814875:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787791087.814877:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787791087.814880:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.814881:0:22718:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787791087.814884:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787791087.814889:0:22718:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787791087.814893:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.814894:0:22718:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787791087.814897:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787791087.814902:0:22718:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787791087.814929:0:22718:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787791087.814931:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787791087.814946:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9170eef50000) 00000020:00000080:3.0:1787791087.814964:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787791087.814967:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787791087.815042:0:22718:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787791087.815047:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787791087.815052:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f40c 00010000:00080000:3.0:1787791087.815079:0:22718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f5039000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787791087.815299:0:22718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787791087.815935:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787791087.816012:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.819260:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172160 00000100:00100000:3.0:1787791087.819277:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172160 00000100:00100000:3.0:1787791087.819322:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787791087.819330:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268172160:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1787791087.819351:0:22705:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1787791087.823784:0:22718:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787791087.824769:0:22718:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787791087.840173:0:22718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787791087.842025:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268172160:12345-0@lo:38:llog_process_th.0 Request processed in 22686us (26003us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787791087.842045:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787791087.842190:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791087.842196:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787791087.842201:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172160:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787791087.842387:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1787791087.852113:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787791087.855666:0:22724:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787791087.855675:0:22724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787791087.857837:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787791087.862300:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787791087.862380:0:22718:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787791087.862408:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f413 00000100:00080000:2.0:1787791087.862422:0:22718:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787791087.862429:0:22718:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170f5039000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791087.862482:0:22718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3765680 x1874634268172288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787791087.862506:0:22718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787791087.863963:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787791087.863977:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791087.863979:0:22718:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787791087.864000:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787791087.864003:0:22718:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787791087.864005:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787791087.864007:0:22718:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787791087.864009:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787791087.864012:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791087.864013:0:22718:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787791087.864016:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787791087.864021:0:22718:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787791087.864024:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791087.864026:0:22718:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787791087.864030:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787791087.864035:0:22718:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:2.0:1787791087.864065:0:22718:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787791087.864068:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787791087.864087:0:22718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9170facf19b8) 00000020:00000080:2.0:1787791087.864108:0:22718:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1787791087.864114:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787791087.864194:0:22718:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787791087.864201:0:22718:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787791087.864207:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf9477fddcf1f421 00010000:00080000:2.0:1787791087.864243:0:22718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f3c7e000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787791087.864482:0:22718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000100:00100000:0.0:1787791087.864860:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172288:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787791087.864917:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268172288 offset 0 length 520: 4 00000040:01000000:2.0:1787791087.865358:0:22718:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787791087.865375:0:22718:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787791087.869463:0:22718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791087.870316:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787791087.870602:0:22718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1787791087.872534:0:22726:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787791087.872544:0:22726:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787791087.882018:0:22718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787791087.882042:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787791087.882109:0:22718:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787791087.882296:0:22718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f428 00000100:00080000:1.0:1787791087.882312:0:22718:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787791087.882321:0:22718:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170f3c7e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791087.882450:0:22718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b903c0 x1874634268172416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791087.882559:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172416:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787791087.882752:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268172416 offset 0 length 520: 4 00000100:00080000:1.0:1787791087.882849:0:22718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787791087.882965:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791087.882971:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.882974:0:22718:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787791087.882978:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791087.882994:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.882996:0:22718:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787791087.883001:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787791087.883004:0:22718:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787791087.883007:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791087.883009:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.883010:0:22718:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787791087.883021:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791087.883025:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791087.883027:0:22718:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787791087.883032:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787791087.883071:0:22718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22718:1874634268172544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787791087.883209:0:22718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.883246:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791087.883319:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172544 00000100:00100000:3.0:1787791087.883339:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172544 00000100:00100000:3.0:1787791087.883425:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787791087.883436:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22718:x1874634268172544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787791087.883663:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22718:x1874634268172544:12345-0@lo:502:llog_process_th.0 Request processed in 228us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.883671:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787791087.884407:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b921c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22718:1874634268172544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787791087.884454:0:22718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787791087.884463:0:22718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791087.884465:0:22718:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787791087.884472:0:22718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787791087.885110:0:22679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787791087.885163:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787791087.885195:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f3a3 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.885213:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d3200/0xcf9477fddcf1f39c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f3a3 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791087.885223:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f39e2000 from 1 10000000:01000000:3.0:1787791087.885227:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787791087.885284:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.885313:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.885324:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791087.885361:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787791087.885444:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.885490:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f39ef780 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.885645:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172672 00000100:00100000:2.0:1787791087.885653:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172672 00000100:00100000:2.0:1787791087.885748:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787791087.885761:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+9:22679:x1874634268172672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791087.885777:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791087.885798:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f42f expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.885828:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 10 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.885840:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 10 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.885851:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3800, rc 0) 00000100:00100000:2.0:1787791087.885904:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+10:22679:x1874634268172672:12345-0@lo:101:mount.lustre.0 Request processed in 146us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.885911:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791087.886002:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.886033:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.886045:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.888107:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787791087.888211:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.889074:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.890796:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172800 00000100:00100000:2.0:1787791087.890811:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172800 00000100:00100000:3.0:1787791087.890991:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787791087.891006:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+10:22679:x1874634268172800:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787791087.891034:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787791087.891040:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787791087.891977:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+10:22679:x1874634268172800:12345-0@lo:256:mount.lustre.0 Request processed in 970us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.892001:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791087.894845:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787791087.895900:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787791087.895975:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.896000:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791087.896010:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f39e2000 from 1 10000000:01000000:1.0:1787791087.896013:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787791087.896056:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.896097:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.896108:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.896133:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787791087.896222:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.896269:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791087.896391:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268172928 00000100:00100000:3.0:1787791087.896399:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268172928 00000100:00100000:3.0:1787791087.896452:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787791087.896462:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+10:22679:x1874634268172928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791087.896475:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791087.896490:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f43d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.896511:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 11 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.896545:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 11 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791087.896554:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb600, rc 0) 00000100:00100000:3.0:1787791087.896598:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268172928:12345-0@lo:101:mount.lustre.0 Request processed in 138us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.896605:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791087.896855:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268172928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.896870:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.896879:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.896939:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791087.896965:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.897002:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791087.897057:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173056 00000100:00100000:3.0:1787791087.897061:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173056 00000100:00100000:3.0:1787791087.897089:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787791087.897095:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268173056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791087.897235:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268173056:12345-0@lo:501:mount.lustre.0 Request processed in 140us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.897242:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787791087.897385:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791087.897413:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791087.897453:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.897476:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791087.898404:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173184 00000100:00100000:3.0:1787791087.898414:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173184 00000100:00100000:3.0:1787791087.898463:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787791087.898471:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268173184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791087.898928:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268173184:12345-0@lo:503:mount.lustre.0 Request processed in 456us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.898938:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787791087.899213:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791087.899621:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22728:1874634268173312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787791087.899673:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.899735:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.899912:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173312 00000100:00100000:1.0:1787791087.899923:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173312 00000100:00100000:1.0:1787791087.899967:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787791087.899975:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22728:x1874634268173312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787791087.903313:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22728:x1874634268173312:12345-0@lo:502:llog_process_th.0 Request processed in 3324us (3625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.903333:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787791087.903528:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22728:1874634268173312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787791087.903595:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791087.903609:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903611:0:22728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787791087.903621:0:22728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f39e2000 00000020:00000080:3.0:1787791087.903624:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791087.903645:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791087.903648:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903649:0:22728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787791087.903652:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791087.903654:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903655:0:22728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787791087.903658:0:22728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f39e2000 00000020:00000080:3.0:1787791087.903660:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791087.903769:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791087.903774:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903775:0:22728:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787791087.903778:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791087.903781:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903793:0:22728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787791087.903798:0:22728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f39e2000 00000020:00000080:3.0:1787791087.903800:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791087.903828:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791087.903831:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903833:0:22728:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787791087.903835:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791087.903838:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791087.903839:0:22728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787791087.903843:0:22728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f39e2000 00000020:00000080:3.0:1787791087.903845:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787791087.903923:0:22728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22728:1874634268173440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787791087.904001:0:22728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791087.904053:0:22728:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8090c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.904226:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173440 00000100:00100000:1.0:1787791087.904236:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173440 00000100:00100000:1.0:1787791087.904304:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787791087.904319:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22728:x1874634268173440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787791087.904468:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22728:x1874634268173440:12345-0@lo:502:llog_process_th.0 Request processed in 154us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.904477:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787791087.904578:0:22728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22728:1874634268173440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787791087.904607:0:22728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791087.904621:0:22728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791087.904623:0:22728:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787791087.904629:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787791087.905044:0:22679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787791087.905076:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787791087.905103:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905118:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791087.905207:0:22679:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787791087.905211:0:22679:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f39e2000 10000000:01000000:1.0:1787791087.905216:0:22679:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f39e2000 10000000:01000000:1.0:1787791087.905222:0:22679:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787791087.905231:0:22679:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f39e2000 from 1 10000000:01000000:1.0:1787791087.905234:0:22679:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787791087.905273:0:22679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905294:0:22679:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905307:0:22679:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.905330:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787791087.905382:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.905419:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.905445:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173568 00000100:00100000:1.0:1787791087.905450:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173568 00000100:00100000:1.0:1787791087.905486:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787791087.905495:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22679:x1874634268173568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.905508:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791087.905526:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d5800/0xcf9477fddcf1f452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f44b expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905580:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d5800/0xcf9477fddcf1f452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f44b expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905594:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d5800/0xcf9477fddcf1f452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f44b expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905605:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5800, rc 0) 00000100:00100000:1.0:1787791087.905643:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268173568:12345-0@lo:101:mount.lustre.0 Request processed in 148us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.905650:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787791087.905751:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791087.905770:0:22679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f452 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.905780:0:22679:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f452 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.905844:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791087.905873:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.905896:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787791087.906047:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173696 00000100:00100000:3.0:1787791087.906054:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173696 00000100:00100000:3.0:1787791087.906085:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787791087.906094:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268173696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791087.906255:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268173696:12345-0@lo:501:mount.lustre.0 Request processed in 162us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791087.906265:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787791087.911160:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791087.911260:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791087.911375:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.911433:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173824 00000100:00100000:1.0:1787791087.911440:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173824 00000100:00100000:1.0:1787791087.911506:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787791087.911518:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268173824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791087.911668:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268173824:12345-0@lo:503:mount.lustre.0 Request processed in 152us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.911678:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787791087.911784:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.911798:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268173824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787791087.916510:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268173952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787791087.916767:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791087.916806:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbdd2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.919139:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268173952 00000100:00100000:1.0:1787791087.919163:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268173952 00000100:00100000:1.0:1787791087.919263:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787791087.919276:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268173952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787791087.919543:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268173952:12345-0@lo:502:llog_process_th.0 Request processed in 269us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791087.919553:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787791087.922850:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268173952:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787791087.922991:0:22732:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787791087.923013:0:22732:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9170facf4d28) 00000020:00000080:2.0:1787791087.923042:0:22732:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1787791087.923178:0:22732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f39e2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787791087.923182:0:22732:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f39e2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787791087.923185:0:22732:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f39e2000 4 00010000:00080000:2.0:1787791087.923225:0:22732:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f39a8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787791087.932737:0:22732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787791087.934834:0:22732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787791087.934904:0:22732:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787791087.934924:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf9477fddcf1f460 00000100:00080000:0.0:1787791087.934939:0:22732:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787791087.934946:0:22732:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9170f39a8800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791087.935002:0:22732:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a552c0 x1874634268174080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791087.935056:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268174080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787791087.935158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787791087.935232:0:22732:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787791087.935587:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174080 00000100:00100000:2.0:1787791087.935602:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174080 00000100:00100000:2.0:1787791087.935652:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791087.935661:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268174080:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787791087.935800:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268174080:12345-0@lo:38:llog_process_th.0 Request processed in 138us (641us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787791087.935810:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787791087.936234:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791087.936246:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f39a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791087.936251:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787791087.936255:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268174080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787791087.936468:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268174208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787791087.936530:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.936567:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174208 00000100:00100000:0.0:1787791087.936573:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174208 00000100:00100000:0.0:1787791087.936610:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787791087.936620:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268174208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787791087.936768:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268174208:12345-0@lo:502:llog_process_th.0 Request processed in 149us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791087.936776:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787791087.936826:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791087.936840:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268174208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787791087.936873:0:22732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268174336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787791087.936902:0:22732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.937454:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174336 00000100:00100000:0.0:1787791087.937460:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174336 00000100:00100000:0.0:1787791087.937489:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791087.937497:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268174336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787791087.937585:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22732:x1874634268174336:12345-0@lo:502:llog_process_th.0 Request processed in 87us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791087.937592:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791087.937631:0:22732:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791087.937647:0:22732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22732:1874634268174336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787791087.937672:0:22732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787791087.937964:0:22679:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787791087.938001:0:22679:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787791087.938031:0:22679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f452 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.938044:0:22679:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d5200/0xcf9477fddcf1f44b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f452 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787791087.938111:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787791087.938114:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787791087.938116:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791087.938117:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791087.938118:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791087.938120:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791087.938121:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787791087.938123:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787791087.941908:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791087.941918:0:22679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787791087.941925:0:22679:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787791087.941931:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787791087.941933:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787791087.941934:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791087.941936:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791087.941937:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791087.941938:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791087.941939:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787791087.941941:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787791087.941943:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791087.941944:0:22679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787791087.941992:0:22679:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787791087.942024:0:22679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268174464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787791087.942149:0:22679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.942213:0:22679:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f840 going to sleep for 11 seconds 00000100:00100000:2.0:1787791087.942374:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174464 00000100:00100000:2.0:1787791087.942384:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174464 00000100:00100000:2.0:1787791087.942458:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787791087.942471:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268174464:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787791087.942509:0:22693:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787791087.942527:0:22693:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787791087.957337:0:22693:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787791087.957364:0:22693:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787791087.958111:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22679:x1874634268174464:12345-0@lo:253:mount.lustre.0 Request processed in 15634us (15954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.958158:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:1.0:1787791087.958749:0:22716:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787791087.958756:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787791087.958786:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.958885:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 11 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.958897:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.958963:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 11 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791087.958993:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 11 pid: 22694 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791087.959010:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268174592:0@lo:104: 00000100:00100000:1.0:1787791087.959074:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791087.959205:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c559f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787791087.959265:0:22679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22679:1874634268174464:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787791087.959280:0:22679:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787791087.959284:0:22679:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787791087.959286:0:22679:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787791087.959287:0:22679:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791087.959289:0:22679:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791087.959290:0:22679:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791087.959291:0:22679:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791087.959292:0:22679:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787791087.959294:0:22679:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787791087.959310:0:22679:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791087.959312:0:22679:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787791087.959478:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174592 00000100:00100000:2.0:1787791087.959486:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174592 00000100:00100000:2.0:1787791087.959537:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791087.959548:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268174592:12345-0@lo:104: 00010000:00010000:2.0:1787791087.959564:0:22683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1787791087.959727:0:22679:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1787791087.959948:0:22683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787791087.959956:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268174592:12345-0@lo:104: Request processed in 410us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791087.959964:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787791087.960090:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791087.960100:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960110:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791087.960115:0:22689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960126:0:22689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791087.960134:0:22689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791087.960156:0:22689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791087.960196:0:22689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960203:0:22689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791087.960229:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960236:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa800/0xcf9477fddcf1f42f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f436 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960258:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.960260:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791087.960262:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791087.960315:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787791087.960329:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268174720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791087.960376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791087.960438:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174720 00000100:00100000:0.0:1787791087.960444:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174720 00010000:00010000:0.0:1787791087.960466:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 12 pid: 22694 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791087.960491:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787791087.960500:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3641:x1874634268174720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791087.960512:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791087.960519:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 12 pid: 22694 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960530:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 12 pid: 22694 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960558:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960568:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787791087.960588:0:22685:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001832348s 00010000:00010000:0.0:1787791087.960593:0:22685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960602:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960610:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960617:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960623:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791087.960628:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960635:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960646:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791087.960657:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791087.960688:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3641:x1874634268174720:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791087.960702:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787791087.960773:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268174720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787791087.961853:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f42f expref: 11 pid: 22694 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791087.961875:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268174592:0@lo:104: 00010000:00010000:2.0:1787791087.961900:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.961910:0:22716:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.961917:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791087.961924:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d4600/0xcf9477fddcf1f467 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787791088.011932:0:22679:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1787791088.012918:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787791088.013032:0:22740:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1787791088.013037:0:22740:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1787791088.013437:0:22741:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787791088.014205:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1787791088.014870:0:22741:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1787791088.016623:0:22742:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff916fc3b93c00 x1874634268174848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791088.016651:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00000040:01000000:2.0:1787791088.017241:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787791088.017299:0:22679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787791088.017773:0:22679:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787791088.017804:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787791088.017845:0:22679:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791088.018812:0:22679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787791088.019349:0:22679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787791088.019387:0:22679:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787791088.020586:0:22741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787791088.020680:0:22741:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787791088.023086:0:22679:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1787791088.024253:0:22679:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:3.0:1787791088.027022:0:22679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1787791088.028631:0:22679:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787791088.028682:0:22679:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa8b301977988 00100000:10000000:3.0:1787791088.028692:0:22679:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787791088.029626:0:22679:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787791088.029650:0:22679:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787791088.029672:0:22679:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787791088.029694:0:22679:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1787791088.039628:0:22679:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787791088.039941:0:22679:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787791088.526819:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787791088.974110:0:22736:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787791088.974121:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787791088.975305:0:22736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787791088.975316:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787791089.038344:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 10000000:01000000:0.0:1787791089.226781:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787791089.226790:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f39e2000 from 11 10000000:01000000:0.0:1787791089.226795:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787791089.226850:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791089.226862:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791089.226874:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791089.226902:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268174976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787791089.227061:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791089.227111:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c567ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787791089.228552:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174976 00000100:00100000:2.0:1787791089.228564:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174976 00000100:00100000:2.0:1787791089.228651:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787791089.228663:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+11:22697:x1874634268174976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791089.228679:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791089.228818:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f46e expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791089.228848:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 12 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791089.228860:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 12 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791089.228869:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3800, rc 0) 00000100:00100000:2.0:1787791089.228933:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22697:x1874634268174976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791089.228940:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787791089.229365:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268174976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787791089.229384:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791089.229418:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791089.229479:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268175104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787791089.229522:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791089.229560:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c567ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787791089.229790:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175104 00000100:00100000:2.0:1787791089.229796:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175104 00000100:00100000:2.0:1787791089.229845:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787791089.229852:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22697:x1874634268175104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787791089.229868:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787791089.229884:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787791089.229887:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787791089.229999:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:22697:x1874634268175104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791089.230007:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787791089.230150:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268175104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787791089.230192:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787791089.230199:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791089.230217:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791089.547996:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787791089.996930:0:22736:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787791089.996943:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787791089.998384:0:22736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1787791089.998443:0:22736:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787791090.002788:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:0.0:1787791090.066894:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791090.571928:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791091.085011:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:0.0:1787791091.604625:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791092.111499:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791092.621008:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787791092.854745:0:22984:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787791093.068628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787791093.068635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787791093.068639:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791093.068648:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:3.0:1787791093.068664:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787791093.068672:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff916fc393a800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791093.068700:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e47f4b40 x1874634268175360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787791093.068756:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791093.068760:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791093.068763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791093.068767:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791093.068770:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787791093.068773:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787791093.068775:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170f39a8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791093.068781:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9170f39a8800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791093.068795:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e47f5a40 x1874634268175488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791093.068892:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787791093.068915:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268175232:0@lo:400:kworker.0 00000100:00100000:3.0:1787791093.069588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791093.069653:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175360:0@lo:38:kworker.0 00000100:00100000:3.0:1787791093.069800:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791093.069821:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268175488:0@lo:38:kworker.0 00000100:00100000:3.0:1787791093.069850:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791093.069880:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175232 00000100:00100000:3.0:1787791093.069886:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175232 00000100:00100000:1.0:1787791093.074603:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175360 00000100:00100000:1.0:1787791093.074618:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175360 00000100:00100000:1.0:1787791093.074665:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791093.074674:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268175360:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787791093.074697:0:22706:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787791093.074795:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268175360:12345-0@lo:38:kworker.0 Request processed in 121us (4994us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787791093.074803:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791093.074851:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175488 00000100:00100000:1.0:1787791093.074856:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175488 00000100:00100000:1.0:1787791093.074881:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791093.074887:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634268175488:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787791093.074906:0:22702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 642 last 0 00000020:00000080:1.0:1787791093.074960:0:22702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf9477fddcf1f47c 00000004:00100000:1.0:1787791093.074977:0:22702:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787791093.076146:0:22702:0:(import.c:65:import_set_state_nolock()) ffff916fc1d5b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787791093.076219:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874634268175488:12345-0@lo:38:kworker.0 Request processed in 1329us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791093.076229:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791093.082235:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791093.082259:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3640:x1874634268175232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791093.082368:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3640:x1874634268175232:12345-0@lo:400:kworker.0 Request processed in 119us (12780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791093.082376:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787791093.082655:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268175232:0@lo:400:kworker.0 00000100:00080000:3.0:1787791093.082748:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791093.082755:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787791093.082758:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175360:0@lo:38:kworker.0 00010000:00080000:3.0:1787791093.082776:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9170e47f5a40 x1874634268175488/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787791093.082793:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787791093.082803:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787791093.082809:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787791093.082812:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f39a8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791093.082818:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874634268175488:0@lo:38:kworker.0 00000100:00100000:2.0:1787791093.133505:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791093.648685:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787791093.858244:0:23037:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787791093.858463:0:23037:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787791094.154832:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791094.669581:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787791094.708897:0:23087:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787791094.709126:0:23087:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787791095.179029:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:2.0:1787791095.695676:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791096.207433:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791096.720474:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791097.181329:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791087/real 1787791087] req@ffff916fc3b903c0 x1874634268172416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791097 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791097.181361:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3b903c0 x1874634268172416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791097 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791097.181373:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791087/real 1787791087] req@ffff916fc3765680 x1874634268172288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791097 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791097.181383:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3765680 x1874634268172288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791097 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787791097.181402:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791097.181417:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787791097.181428:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172416:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787791097.181434:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791097.181439:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787791097.181443:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268172288:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787791097.182383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787791097.182389:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787791097.182392:0:37:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787791097.182398:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 642 00000100:00080000:2.0:1787791097.182404:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787791097.182411:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff916fc393a800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791097.182433:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3764000 x1874634268175744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787791097.182448:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791097.182451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787791097.182453:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787791097.182457:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:2.0:1787791097.182460:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787791097.182463:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170f5039000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791097.182475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc37661c0 x1874634268175872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787791097.182491:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791097.182494:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787791097.182496:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787791097.182499:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:2.0:1787791097.182502:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787791097.182505:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170f3c7e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791097.182517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3765a40 x1874634268176000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787791097.182604:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268175616:0@lo:400:kworker.0 00000100:00100000:2.0:1787791097.182677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791097.182741:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787791097.182748:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268176128:0@lo:400:kworker.0 00000100:00100000:2.0:1787791097.182776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791097.182807:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175616 00000100:00100000:2.0:1787791097.182815:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175616 00000100:00100000:2.0:1787791097.182857:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787791097.182867:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3638:x1874634268175616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791097.182927:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:3638:x1874634268175616:12345-0@lo:400:kworker.0 Request processed in 61us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791097.182935:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787791097.182967:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176128 00000100:00100000:2.0:1787791097.182970:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176128 00000100:00100000:2.0:1787791097.182998:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791097.183005:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791097.183037:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268176128:12345-0@lo:400:kworker.0 Request processed in 33us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791097.183065:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787791097.183101:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff916fc3767c00 x1874634268176128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791097.183114:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268176128:0@lo:400:kworker.0 00000100:00100000:2.0:1787791097.183124:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268175616:0@lo:400:kworker.0 00000100:00100000:3.0:1787791097.184944:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175744:0@lo:38:kworker.0 00000100:00100000:3.0:1787791097.185007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791097.185087:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175872:0@lo:8:kworker.0 00000400:00000100:3.0:1787791097.185112:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268175872 offset 0 length 520: 4 00000100:00100000:3.0:1787791097.185125:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268176000:0@lo:8:kworker.0 00000400:00000100:3.0:1787791097.185145:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268176000 offset 0 length 520: 4 00000100:00100000:2.0:1787791097.201784:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268175744 00000100:00100000:2.0:1787791097.201799:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268175744 00000100:00100000:2.0:1787791097.202512:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787791097.202524:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268175744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787791097.204804:0:22705:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787791097.204912:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268175744:12345-0@lo:38:kworker.0 Request processed in 2375us (19890us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787791097.204924:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787791097.205002:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787791097.205008:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787791097.205012:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175744:0@lo:38:kworker.0 00000100:00100000:0.0:1787791097.234549:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:2.0:1787791097.739113:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791098.250884:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791098.766173:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787791099.211672:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787791099.277857:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:2.0:1787791099.792058:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791100.304451:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:3.0:1787791100.817154:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791101.322788:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00000020:01000004:0.0:1787791101.528809:0:23433:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787791101.528815:0:23433:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787791101.528817:0:23433:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787791101.529607:0:23433:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170ce838000 00000020:01000004:0.0:1787791101.529634:0:23433:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1787791101.529649:0:23433:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787791101.529669:0:23433:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff916fc34acd28) 00000020:00000080:0.0:1787791101.529691:0:23433:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787791101.606676:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787791101.608031:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787791101.610026:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.610292:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.610589:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.610838:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.611120:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.613806:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.614138:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.614685:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.615373:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.615680:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.616364:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.616624:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.616919:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.617496:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.617881:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.618190:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.618393:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.618923:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.619270:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.619464:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.619770:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.620433:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.621157:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.621397:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.621849:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.622188:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.622385:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.622622:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.622988:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.623275:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.623582:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787791101.623806:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787791101.625287:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787791101.625736:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.625927:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787791101.626095:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787791101.626255:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787791101.626419:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.626981:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.627286:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787791101.627526:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.627821:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.628047:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1787791101.628286:0:23433:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1787791101.629134:0:23433:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787791101.629419:0:23433:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787791101.629432:0:23433:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787791101.629448:0:23433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f48a 00000020:01000004:0.0:1787791101.629457:0:23433:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787791101.629484:0:23433:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787791101.629488:0:23433:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787791101.629496:0:23433:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787791101.629529:0:23433:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787791101.629534:0:23433:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787791101.635325:0:23433:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787791101.635382:0:23433:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787791101.635388:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787791101.635390:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787791101.635392:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787791101.635393:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787791101.635395:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787791101.635397:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787791101.635403:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787791101.635405:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787791101.635407:0:23433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787791101.635412:0:23433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787791101.635414:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787791101.635416:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787791101.635417:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787791101.635418:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787791101.635419:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787791101.635420:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787791101.635421:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787791101.635422:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787791101.635423:0:23433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787791101.635470:0:23433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787791101.635581:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787791101.635685:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.635850:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc31d2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.635916:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176256 00000100:00100000:3.0:1787791101.635925:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176256 00000100:00100000:3.0:1787791101.636027:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787791101.636039:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:23433:x1874634268176256:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787791101.636088:0:22694:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787791101.636094:0:22694:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787791101.636106:0:22694:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1787791101.638768:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:23433:x1874634268176256:12345-0@lo:253:mount.lustre.0 Request processed in 2718us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.638787:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787791101.643192:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176256:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787791101.643222:0:23433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787791101.643226:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787791101.643227:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787791101.643253:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787791101.643255:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787791101.643256:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787791101.643257:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787791101.643258:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787791101.643260:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787791101.643261:0:23433:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787791101.643313:0:23433:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170ce838000 from lustre-MDT0001 10000000:01000000:3.0:1787791101.643362:0:23433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1787791101.643366:0:23433:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1787791101.643375:0:23433:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff916fc45f99b8 local copy 00010000:00010000:3.0:1787791101.643390:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791101.643802:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791101.643905:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.643961:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbec5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.644297:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176384 00000100:00100000:2.0:1787791101.644306:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176384 00000100:00100000:2.0:1787791101.644380:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787791101.644392:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:23433:x1874634268176384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791101.644515:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:23433:x1874634268176384:12345-0@lo:501:mount.lustre.0 Request processed in 124us (609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787791101.644524:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787791101.644976:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176384:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787791101.645015:0:23433:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787791101.645046:0:23433:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787791101.645055:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.645065:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791101.645099:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170ce838000 10000000:01000000:3.0:1787791101.645105:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787791101.645111:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff916fc45f99b8 10000000:01000000:3.0:1787791101.645114:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787791101.645118:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff916fc45f99b8 from 1 10000000:01000000:3.0:1787791101.645136:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787791101.645173:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.645182:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.645192:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791101.645210:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787791101.645251:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.645292:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbec5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.645359:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176512 00000100:00100000:2.0:1787791101.645364:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176512 00000100:00100000:2.0:1787791101.645411:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787791101.645421:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+12:23433:x1874634268176512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791101.645434:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791101.645456:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f498 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f491 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.645483:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f491 expref: 13 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.645496:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3e00/0xcf9477fddcf1f498 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f491 expref: 13 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.645516:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3e00, rc 0) 00000100:00100000:2.0:1787791101.645563:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+13:23433:x1874634268176512:12345-0@lo:101:mount.lustre.0 Request processed in 143us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.645570:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787791101.645657:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.645682:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f498 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.645692:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f498 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.645757:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787791101.645773:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f498 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.645781:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fae00/0xcf9477fddcf1f491 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f498 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.645789:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9170ce838000 10000000:01000000:0.0:1787791101.645798:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787791101.645802:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9170ce838000 from 1 10000000:01000000:0.0:1787791101.645804:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787791101.645822:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.645830:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.645837:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.645852:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791101.645895:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.645921:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176640 00000100:00100000:0.0:1787791101.645931:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176640 00000100:00100000:0.0:1787791101.645955:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787791101.645962:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+13:23433:x1874634268176640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.645969:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791101.645977:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165f200/0xcf9477fddcf1f4a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f49f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.645992:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165f200/0xcf9477fddcf1f4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f49f expref: 14 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646002:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165f200/0xcf9477fddcf1f4a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f49f expref: 14 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646008:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165f200, rc 0) 00000100:00100000:0.0:1787791101.646031:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+14:23433:x1874634268176640:12345-0@lo:101:mount.lustre.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.646038:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787791101.646061:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791101.646073:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.646083:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4a6 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646090:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f4a6 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.646101:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787791101.646105:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4a6 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646123:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c165ec00/0xcf9477fddcf1f49f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4a6 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.646130:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787791101.646133:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787791101.646138:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9170ce838000 10000000:01000000:0.0:1787791101.646140:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787791101.646144:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787791101.646146:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787791101.646160:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646167:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646174:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.646186:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791101.646210:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.646228:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176768 00000100:00100000:0.0:1787791101.646232:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176768 00000100:00100000:0.0:1787791101.646248:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791101.646253:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+14:23433:x1874634268176768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.646259:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791101.646267:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170c165f000/0xcf9477fddcf1f4b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f4ad expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646291:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170c165f000/0xcf9477fddcf1f4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f4ad expref: 15 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646300:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170c165f000/0xcf9477fddcf1f4b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f4ad expref: 15 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646307:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170c165f000, rc 0) 00000100:00100000:0.0:1787791101.646330:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268176768:12345-0@lo:101:mount.lustre.0 Request processed in 77us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.646336:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791101.646356:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791101.646367:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.646377:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4b4 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.646386:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f4b4 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787791101.649481:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1787791101.654268:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787791101.664085:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1787791101.664166:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1787791101.664181:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1787791101.664195:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1787791101.664215:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1787791101.664228:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1787791101.664242:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1787791101.664256:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1787791101.664282:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1787791101.664296:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1787791101.664309:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1787791101.664322:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1787791101.664335:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1787791101.664347:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1787791101.664361:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1787791101.664374:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1787791101.665135:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1787791101.665191:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1787791101.665210:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1787791101.665229:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1787791101.665244:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1787791101.665257:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1787791101.665269:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1787791101.665281:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1787791101.665294:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1787791101.665307:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1787791101.665320:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1787791101.665332:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1787791101.665345:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1787791101.665359:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1787791101.665374:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1787791101.665387:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1787791101.665400:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1787791101.665415:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1787791101.665429:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1787791101.665446:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1787791101.665462:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1787791101.665476:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1787791101.665490:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1787791101.665503:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1787791101.665517:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1787791101.665556:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1787791101.665571:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1787791101.665583:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1787791101.665615:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1787791101.665621:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787791101.666680:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791101.666845:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.666903:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352540 going to sleep for 11 seconds 00000100:00100000:0.0:1787791101.667120:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268176896 00000100:00100000:0.0:1787791101.667129:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268176896 00000100:00100000:0.0:1787791101.667266:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787791101.667278:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268176896:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791101.670174:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268176896:12345-0@lo:501:mount.lustre.0 Request processed in 2885us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.670195:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787791101.670425:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268176896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791101.670493:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787791101.670576:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.670623:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352540 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.670852:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177024 00000100:00100000:3.0:1787791101.670870:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177024 00000100:00100000:3.0:1787791101.670934:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787791101.670944:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791101.672535:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177024:12345-0@lo:503:mount.lustre.0 Request processed in 1583us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.672551:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787791101.672778:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177024:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787791101.674312:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787791101.674444:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791101.675126:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.675219:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c8352540 going to sleep for 11 seconds 00000100:00100000:1.0:1787791101.675269:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177152 00000100:00100000:1.0:1787791101.675278:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177152 00000100:00100000:1.0:1787791101.675379:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787791101.675390:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791101.676435:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177152:12345-0@lo:502:mount.lustre.0 Request processed in 1041us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.676448:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787791101.676731:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787791101.677111:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787791101.677145:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787791101.677160:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787791101.677173:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787791101.677188:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787791101.677202:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787791101.677213:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787791101.677229:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787791101.677242:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787791101.677253:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787791101.677263:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787791101.677281:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787791101.677293:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787791101.677304:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787791101.677317:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787791101.677328:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787791101.677338:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1787791101.677349:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1787791101.677360:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1787791101.677370:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1787791101.677381:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787791101.677391:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787791101.677401:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787791101.677413:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787791101.677425:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787791101.677436:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787791101.677447:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787791101.677458:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787791101.677468:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787791101.677479:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787791101.677491:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787791101.678615:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787791101.678683:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787791101.678698:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787791101.679083:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787791101.679106:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787791101.679118:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787791101.679130:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787791101.679141:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787791101.679154:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787791101.679165:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787791101.679179:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787791101.679191:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787791101.679202:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787791101.679260:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791101.679359:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.679416:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbf30900 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.679635:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177280 00000100:00100000:3.0:1787791101.679644:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177280 00000100:00100000:3.0:1787791101.679695:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787791101.679737:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791101.679897:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268177280:12345-0@lo:502:mount.lustre.0 Request processed in 193us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.679906:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787791101.680399:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268177280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787791101.680481:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787791101.680495:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787791101.681685:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787791101.681702:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.681732:0:23437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787791101.681739:0:23437:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787791101.681832:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787791101.681865:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9170facf3370) 00000020:00000080:2.0:1787791101.681897:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787791101.681905:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787791101.682040:0:23437:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787791101.682051:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f4c2 00000020:00000080:2.0:1787791101.682313:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787791101.682318:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787791101.682322:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.682329:0:23437:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787791101.682333:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787791101.682337:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.682338:0:23437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787791101.682342:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787791101.682353:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9170d6384d28) 00000020:00000080:2.0:1787791101.682367:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787791101.682371:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787791101.682374:0:23437:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787791101.682377:0:23437:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787791101.682383:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787791101.682441:0:23437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170ce838000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787791101.682456:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9170d6380000) 00000020:00000080:2.0:1787791101.682466:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787791101.682702:0:23437:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787791101.682877:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f4d7 00000020:00000080:2.0:1787791101.683065:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787791101.683076:0:23437:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787791101.683081:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf9477fddcf1f4de 00080000:01000000:2.0:1787791101.683087:0:23437:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787791101.683092:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f4e5 00010000:00010000:2.0:1787791101.829329:0:23437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787791101.830471:0:23437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00010000:00010000:2.0:1787791101.836415:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787791101.837830:0:23437:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787791101.845839:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787791101.845865:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791101.845963:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791101.845967:0:23437:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787791101.845972:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791101.845979:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791101.845980:0:23437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787791101.845984:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787791101.845990:0:23437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:3.0:1787791101.846022:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787791101.846040:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9170eef54d28) 00000020:00000080:3.0:1787791101.846065:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787791101.846070:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787791101.847318:0:23437:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787791101.847331:0:23437:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787791101.847343:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f4f3 00010000:00080000:3.0:1787791101.847391:0:23437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170c5664800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787791101.859903:0:23437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1787791101.871994:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787791101.872018:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787791101.872083:0:23437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787791101.872118:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f4fa 00000100:00080000:1.0:1787791101.872133:0:23437:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787791101.872142:0:23437:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9170c5664800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791101.872199:0:23437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b90780 x1874634268177408/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791101.872236:0:23437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787791101.872311:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791101.872316:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872318:0:23437:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787791101.872322:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787791101.872325:0:23437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787791101.872327:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787791101.872329:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787791101.872331:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787791101.872334:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872336:0:23437:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787791101.872338:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791101.872343:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872345:0:23437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787791101.872349:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787791101.872383:0:23437:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787791101.872395:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791101.872398:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872400:0:23437:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787791101.872425:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787791101.872427:0:23437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1787791101.872428:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787791101.872431:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787791101.872433:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787791101.872437:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872440:0:23437:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000100:00080000:0.0:1787791101.872440:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:01000000:1.0:1787791101.872446:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787791101.872456:0:23437:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000100:00080000:0.0:1787791101.872457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787791101.872464:0:37:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:1.0:1787791101.872465:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.872472:0:23437:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787791101.872480:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000100:00080000:0.0:1787791101.872480:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 646 00000020:00000080:1.0:1787791101.872490:0:23437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000100:00080000:0.0:1787791101.872492:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787791101.872505:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff916fc393a800 using connection 192.168.202.122@tcp/0@lo 00000020:01000000:1.0:1787791101.872532:0:23437:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787791101.872536:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1787791101.872552:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a561c0 x1874634268177536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:1.0:1787791101.872555:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9170eef319b8) 00000100:00080000:0.0:1787791101.872573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1787791101.872576:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000100:00080000:0.0:1787791101.872579:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791101.872585:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:00000080:1.0:1787791101.872587:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:0.0:1787791101.872590:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787791101.872650:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268177664:0@lo:400:kworker.0 00000004:00080000:1.0:1787791101.872671:0:23437:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787791101.872681:0:23437:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787791101.872691:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f508 00000100:00100000:0.0:1787791101.872770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787791101.872773:0:23437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170f3c46000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.122@tcp at head 00000100:00100000:0.0:1787791101.872880:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177664 00000100:00100000:0.0:1787791101.872889:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177664 00010000:00010000:1.0:1787791101.873062:0:23437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1787791101.873253:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791101.873271:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791101.873467:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268177664:12345-0@lo:400:kworker.0 Request processed in 201us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.873476:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787791101.873520:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3a57840 x1874634268177664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791101.873534:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a57840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268177664:0@lo:400:kworker.0 00000100:00100000:2.0:1787791101.873627:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268177408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787791101.873669:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.873728:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268177536:0@lo:38:kworker.0 00000100:00100000:2.0:1787791101.873751:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.873817:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177408 00000100:00100000:3.0:1787791101.873824:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177408 00000100:00100000:3.0:1787791101.873841:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177536 00000100:00100000:3.0:1787791101.873844:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177536 00000100:00100000:3.0:1787791101.873855:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791101.873883:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268177408:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787791101.873907:0:22706:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1787791101.873954:0:22706:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f50f 00000004:00100000:3.0:1787791101.873970:0:22706:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787791101.873977:0:22706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1787791101.876264:0:23437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787791101.876593:0:23437:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1787791101.878532:0:23437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787791101.878775:0:23437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1787791101.878911:0:23437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787791101.881683:0:23442:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787791101.881739:0:23442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787791101.885650:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787791101.885666:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787791101.885741:0:23437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787791101.885789:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f516 00000100:00080000:2.0:1787791101.885800:0:23437:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787791101.885808:0:23437:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170f3c46000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791101.885845:0:23437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3766d00 x1874634268177792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791101.885930:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268177792:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787791101.886037:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268177792 offset 0 length 520: 4 00000100:00080000:2.0:1787791101.886104:0:23437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787791101.886210:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787791101.886215:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.886217:0:23437:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787791101.886221:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787791101.886225:0:23437:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787791101.886227:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787791101.886228:0:23437:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787791101.886230:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787791101.886233:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.886235:0:23437:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787791101.886239:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787791101.886244:0:23437:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787791101.886248:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791101.886251:0:23437:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787791101.886256:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787791101.886262:0:23437:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:2.0:1787791101.886289:0:23437:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787791101.886292:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787791101.886305:0:23437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9170d63819b8) 00000020:00000080:2.0:1787791101.886322:0:23437:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787791101.886329:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787791101.886406:0:23437:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787791101.886414:0:23437:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787791101.886421:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf9477fddcf1f524 00010000:00080000:2.0:1787791101.886452:0:23437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170c7da2000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.122@tcp at head 00000100:00080000:0.0:1787791101.886589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.886600:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791101.886604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.886608:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787791101.886684:0:23437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787791101.886784:0:23437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787791101.886802:0:23437:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1787791101.890995:0:22706:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1787791101.892624:0:23437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787791101.893954:0:23437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787791101.894212:0:23437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:2.0:1787791101.895886:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268177408:12345-0@lo:38:llog_process_th.0 Request processed in 21987us (22200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.895901:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787791101.895934:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787791101.895941:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268177536:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787791101.896016:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1874634268177536:12345-0@lo:38:kworker.0 Request processed in 75us (22264us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787791101.896023:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787791101.896700:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791101.896727:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787791101.896738:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787791101.896745:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787791101.896760:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c5664800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791101.896790:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268177408:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791101.896807:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791101.896812:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791101.896816:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787791101.896819:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268177536:0@lo:38:kworker.0 00000100:00100000:0.0:1787791101.897063:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268177920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791101.897152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791101.897586:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268177920 00000100:00100000:1.0:1787791101.897596:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268177920 00000100:00100000:1.0:1787791101.897667:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787791101.897678:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1874634268177920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787791101.897759:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787791101.897850:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1874634268177920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 171us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.897867:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791101.898149:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268177920:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1787791101.899238:0:23444:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787791101.899248:0:23444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787791101.900455:0:23437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787791101.900476:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787791101.900638:0:23437:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787791101.900672:0:23437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f52b 00000100:00080000:1.0:1787791101.900687:0:23437:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787791101.900694:0:23437:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170c7da2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791101.901060:0:23437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b930c0 x1874634268178048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791101.901084:0:23437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787791101.901167:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791101.901172:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.901175:0:23437:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787791101.901178:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791101.901182:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.901184:0:23437:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787791101.901187:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787791101.901189:0:23437:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787791101.901191:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791101.901194:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.901195:0:23437:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787791101.901198:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791101.901200:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.901202:0:23437:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787791101.901206:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787791101.901247:0:23437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791101.901250:0:23437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791101.901252:0:23437:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787791101.901256:0:23437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:2.0:1787791101.901352:0:23433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1787791101.901418:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787791101.901451:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4b4 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.901465:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170c165f800/0xcf9477fddcf1f4ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f4b4 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791101.901474:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce838000 from 1 10000000:01000000:2.0:1787791101.901477:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791101.901522:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.901531:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.901563:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791101.901595:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787791101.901679:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.901773:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268178048:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787791101.901831:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268178048 offset 0 length 520: 4 00000100:00100000:3.0:1787791101.901886:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178176 00000100:00100000:3.0:1787791101.901894:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178176 00000100:00100000:3.0:1787791101.901957:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787791101.901967:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+15:23433:x1874634268178176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791101.901985:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791101.902006:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f532 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.902040:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 16 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.902054:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 16 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.902084:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:3.0:1787791101.902130:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:23433:x1874634268178176:12345-0@lo:101:mount.lustre.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.902137:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787791101.902439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.902445:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791101.902452:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124ba80 going to sleep for 11 seconds 00000100:00080000:0.0:1787791101.902459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.902465:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791101.902500:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791101.902522:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.902533:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791101.905403:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178304:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787791101.905491:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.905542:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787791101.905571:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178304 00000100:00100000:1.0:1787791101.905605:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178304 00000100:00100000:1.0:1787791101.905693:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787791101.905759:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:23433:x1874634268178304:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787791101.905790:0:22695:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787791101.905811:0:22695:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787791101.905815:0:22695:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787791101.905983:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:23433:x1874634268178304:12345-0@lo:256:mount.lustre.0 Request processed in 226us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.905992:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787791101.906911:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178304:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787791101.907542:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787791101.907572:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.907585:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791101.907595:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce838000 from 1 10000000:01000000:2.0:1787791101.907598:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787791101.907645:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.907655:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.907664:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791101.907685:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178432:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787791101.907788:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791101.907831:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff91710124ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.907991:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178432 00000100:00100000:3.0:1787791101.907999:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178432 00000100:00100000:3.0:1787791101.908050:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787791101.908059:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:23433:x1874634268178432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791101.908073:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791101.908088:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f540 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.908115:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.908138:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.908148:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb200, rc 0) 00000100:00100000:3.0:1787791101.908200:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178432:12345-0@lo:101:mount.lustre.0 Request processed in 141us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.908207:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787791101.908457:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791101.908473:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791101.908482:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787791101.912639:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787791101.913185:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791101.913439:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787791101.913468:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787791101.913482:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787791101.913496:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787791101.913509:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787791101.913522:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787791101.913535:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787791101.913548:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787791101.913561:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787791101.913574:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787791101.913597:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787791101.913616:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787791101.913622:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787791101.914997:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791101.915330:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.915451:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791101.915672:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178560 00000100:00100000:0.0:1787791101.915684:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178560 00000100:00100000:0.0:1787791101.915952:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787791101.915965:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791101.916174:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178560:12345-0@lo:501:mount.lustre.0 Request processed in 212us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.916183:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787791101.916286:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791101.916353:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791101.916413:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.916740:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c993c000 going to sleep for 11 seconds 00000100:00100000:1.0:1787791101.916975:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178688 00000100:00100000:1.0:1787791101.916982:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178688 00000100:00100000:1.0:1787791101.917030:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787791101.917039:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178688:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791101.917221:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178688:12345-0@lo:503:mount.lustre.0 Request processed in 184us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.917229:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787791101.917403:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178688:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787791101.918417:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787791101.919080:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178816:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791101.919175:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.919260:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.919391:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178816 00000100:00100000:2.0:1787791101.919399:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178816 00000100:00100000:1.0:1787791101.919635:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787791101.919649:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791101.919871:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178816:12345-0@lo:502:mount.lustre.0 Request processed in 212us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.919880:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787791101.920036:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791101.920344:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787791101.920378:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1787791101.920395:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1787791101.920409:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1787791101.920421:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1787791101.920432:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1787791101.920443:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1787791101.920454:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1787791101.920469:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787791101.920484:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1787791101.920499:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1787791101.920688:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791101.920806:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.920845:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787791101.920935:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268178944 00000100:00100000:1.0:1787791101.920942:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268178944 00000100:00100000:1.0:1787791101.921124:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787791101.921135:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791101.921247:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268178944:12345-0@lo:502:mount.lustre.0 Request processed in 114us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.921261:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787791101.921372:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268178944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791101.921437:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1787791101.921454:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787791101.924695:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791101.924749:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924752:0:23446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787791101.924761:0:23446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170ce838000 00000020:00000080:0.0:1787791101.924764:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787791101.924775:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791101.924778:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924780:0:23446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787791101.924782:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791101.924784:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924785:0:23446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787791101.924789:0:23446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170ce838000 00000020:00000080:0.0:1787791101.924791:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787791101.924871:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791101.924875:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924877:0:23446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787791101.924879:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791101.924882:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924883:0:23446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787791101.924886:0:23446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170ce838000 00000020:00000080:0.0:1787791101.924888:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787791101.924905:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791101.924907:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924908:0:23446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787791101.924911:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791101.924913:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924914:0:23446:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787791101.924918:0:23446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170ce838000 00000020:00000080:0.0:1787791101.924920:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787791101.924939:0:23446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791101.924942:0:23446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791101.924943:0:23446:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787791101.924946:0:23446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1787791101.928075:0:23433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787791101.928141:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787791101.928166:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.928183:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.928266:0:23433:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787791101.928269:0:23433:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170ce838000 10000000:01000000:0.0:1787791101.928273:0:23433:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170ce838000 10000000:01000000:0.0:1787791101.928277:0:23433:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787791101.928284:0:23433:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170ce838000 from 1 10000000:01000000:0.0:1787791101.928287:0:23433:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787791101.928340:0:23433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.928348:0:23433:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.928361:0:23433:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.928393:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791101.928497:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.928554:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.929839:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179072 00000100:00100000:3.0:1787791101.929866:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179072 00000100:00100000:3.0:1787791101.929920:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787791101.929931:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:23433:x1874634268179072:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791101.929952:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791101.929976:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1f555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f54e expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.930084:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1f555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f54e expref: 18 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.930099:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb000/0xcf9477fddcf1f555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f54e expref: 18 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.930109:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb000, rc 0) 00000100:00100000:3.0:1787791101.930197:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179072:12345-0@lo:101:mount.lustre.0 Request processed in 268us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.930206:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787791101.930367:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791101.930389:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f555 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.930416:0:23433:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f555 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787791101.944895:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:3.0:1787791101.945306:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787791101.945599:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1787791101.945633:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:3.0:1787791101.945648:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:3.0:1787791101.945662:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:3.0:1787791101.945676:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:3.0:1787791101.945691:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:3.0:1787791101.945745:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:3.0:1787791101.945764:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:3.0:1787791101.945778:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1787791101.945789:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:3.0:1787791101.945799:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:3.0:1787791101.945809:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:3.0:1787791101.945820:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:3.0:1787791101.945830:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:3.0:1787791101.945840:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:3.0:1787791101.945851:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:3.0:1787791101.945889:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:3.0:1787791101.945903:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:3.0:1787791101.945914:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:3.0:1787791101.945925:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:3.0:1787791101.945936:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:3.0:1787791101.945946:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:3.0:1787791101.945957:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:3.0:1787791101.945968:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:3.0:1787791101.945979:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:3.0:1787791101.945990:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:3.0:1787791101.946000:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:3.0:1787791101.946011:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:3.0:1787791101.946022:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:3.0:1787791101.946033:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:3.0:1787791101.946045:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:3.0:1787791101.946055:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:3.0:1787791101.946079:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:3.0:1787791101.946092:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:3.0:1787791101.946109:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:3.0:1787791101.946120:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:3.0:1787791101.946136:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:3.0:1787791101.946150:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:3.0:1787791101.946163:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:3.0:1787791101.946176:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:3.0:1787791101.946189:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:3.0:1787791101.946202:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:3.0:1787791101.946214:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:3.0:1787791101.946225:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:3.0:1787791101.946236:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:3.0:1787791101.946247:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:3.0:1787791101.946259:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:3.0:1787791101.946270:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:3.0:1787791101.946400:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:3.0:1787791101.946418:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:3.0:1787791101.946432:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:3.0:1787791101.946436:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:3.0:1787791101.946549:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791101.946648:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.946744:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.946767:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179200 00000100:00100000:2.0:1787791101.946777:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179200 00000100:00100000:2.0:1787791101.946844:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787791101.946866:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791101.947018:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179200:12345-0@lo:501:mount.lustre.0 Request processed in 164us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.947027:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787791101.948090:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791101.948155:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179328:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791101.948226:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.948260:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791101.948280:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179328 00000100:00100000:3.0:1787791101.948287:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179328 00000100:00100000:3.0:1787791101.948341:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787791101.948350:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791101.948475:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179328:12345-0@lo:503:mount.lustre.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.948482:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787791101.948541:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179328:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787791101.951654:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787791101.951885:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791101.951994:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.952276:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.952592:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179456 00000100:00100000:2.0:1787791101.952669:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179456 00000100:00100000:2.0:1787791101.952755:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787791101.952767:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791101.952970:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179456:12345-0@lo:502:mount.lustre.0 Request processed in 205us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.952979:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787791101.955416:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179456:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791101.959501:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1787791101.959935:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:3.0:1787791101.959950:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:3.0:1787791101.959964:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:3.0:1787791101.959978:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:3.0:1787791101.959992:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:3.0:1787791101.960081:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:3.0:1787791101.960099:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:3.0:1787791101.960113:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:3.0:1787791101.960154:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:3.0:1787791101.960171:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:3.0:1787791101.960186:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:3.0:1787791101.960206:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:3.0:1787791101.960220:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:3.0:1787791101.960234:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:3.0:1787791101.960249:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:3.0:1787791101.960262:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:3.0:1787791101.960274:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:3.0:1787791101.960287:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:3.0:1787791101.960311:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:3.0:1787791101.960323:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:3.0:1787791101.960336:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:3.0:1787791101.960347:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:3.0:1787791101.960360:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:3.0:1787791101.960372:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:3.0:1787791101.960397:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:3.0:1787791101.960411:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:3.0:1787791101.960423:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:3.0:1787791101.960436:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:3.0:1787791101.960449:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:3.0:1787791101.960461:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:3.0:1787791101.960473:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:3.0:1787791101.960486:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:3.0:1787791101.960499:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:3.0:1787791101.962799:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:3.0:1787791101.962831:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:3.0:1787791101.962846:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:3.0:1787791101.962872:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:3.0:1787791101.962889:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:3.0:1787791101.962902:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:3.0:1787791101.962917:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:3.0:1787791101.962953:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:3.0:1787791101.962967:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:3.0:1787791101.962979:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:3.0:1787791101.962991:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:3.0:1787791101.963124:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:3.0:1787791101.963143:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:3.0:1787791101.963156:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:3.0:1787791101.963229:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791101.963329:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.963386:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791101.964123:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179584 00000100:00100000:1.0:1787791101.964135:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179584 00000100:00100000:1.0:1787791101.964194:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787791101.964204:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791101.964367:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179584:12345-0@lo:502:mount.lustre.0 Request processed in 164us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791101.964375:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787791101.964608:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791101.970993:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:3.0:1787791101.971096:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:3.0:1787791101.971174:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791101.971289:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.971346:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791101.971401:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179712 00000100:00100000:2.0:1787791101.971412:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179712 00000100:00100000:2.0:1787791101.971513:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787791101.971525:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791101.971698:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179712:12345-0@lo:502:mount.lustre.0 Request processed in 174us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791101.971728:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787791101.971803:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f70c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791101.971869:0:23433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:3.0:1787791101.971879:0:23433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1787791101.973880:0:23452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1787791101.973905:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9170d6383370) 00000020:00000080:2.0:1787791101.973940:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1787791101.974070:0:23452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170ce838000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787791101.974076:0:23452:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170ce838000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1787791101.974079:0:23452:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170ce838000 3 00010000:00080000:2.0:1787791101.977777:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170ff55f000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787791101.983324:0:23452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787791101.983691:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787791101.983792:0:23452:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787791101.983812:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf9477fddcf1f563 00000100:00080000:0.0:1787791101.983826:0:23452:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787791101.983834:0:23452:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9170ff55f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791101.983896:0:23452:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3a55a40 x1874634268179840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787791101.983928:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787791101.983962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.983968:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791101.983971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791101.983974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787791101.984128:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268179840:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791101.984236:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.984316:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179840 00000100:00100000:3.0:1787791101.984324:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179840 00000100:00100000:3.0:1787791101.984362:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787791101.984370:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1874634268179840:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787791101.984400:0:22702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1787791101.984440:0:22702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf9477fddcf1f56a 00000004:00100000:3.0:1787791101.984458:0:22702:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787791101.984495:0:22702:0:(import.c:65:import_set_state_nolock()) ffff9170ed8c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791101.984553:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874634268179840:12345-0@lo:38:llog_process_th.0 Request processed in 181us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.984561:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787791101.984607:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3a55a40 x1874634268179840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791101.984618:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791101.984639:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787791101.984647:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787791101.984653:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787791101.984656:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170ff55f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791101.984662:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874634268179840:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787791101.985330:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1787791101.985512:0:23433:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787791101.985549:0:23433:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787791101.985574:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f555 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791101.985588:0:23433:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f200/0xcf9477fddcf1f54e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f555 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787791101.985647:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787791101.985651:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787791101.985652:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787791101.985654:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787791101.985655:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787791101.985657:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787791101.985659:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787791101.985661:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787791101.985663:0:23433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787791101.985668:0:23433:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787791101.985670:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787791101.985672:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787791101.985673:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787791101.985674:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787791101.985675:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787791101.985677:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787791101.985678:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787791101.985679:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787791101.985680:0:23433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787791101.985731:0:23433:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787791101.985750:0:23433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787791101.985820:0:23433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791101.985868:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268179968 00000100:00100000:3.0:1787791101.985874:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268179968 00000100:00100000:3.0:1787791101.985920:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787791101.985928:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787791101.985956:0:22695:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787791101.985972:0:22695:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787791101.986326:0:23433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a3c0 going to sleep for 11 seconds 00000001:00100000:3.0:1787791101.989174:0:22680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787791101.989224:0:22695:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787791101.989248:0:22695:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787791101.990328:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:23433:x1874634268179968:12345-0@lo:253:mount.lustre.0 Request processed in 4389us (4497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791101.990346:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787791101.990440:0:23433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:23433:1874634268179968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787791101.990458:0:23433:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787791101.990462:0:23433:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787791101.990464:0:23433:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787791101.990466:0:23433:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787791101.990467:0:23433:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787791101.990469:0:23433:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787791101.990470:0:23433:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787791101.990472:0:23433:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787791101.990473:0:23433:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787791101.990475:0:23433:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787791101.990495:0:23433:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787791101.993434:0:22716:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787791101.993449:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787791101.993479:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993503:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 17 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993522:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993539:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993591:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993611:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 17 pid: 22693 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.993628:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268180096:0@lo:104: 00000100:00100000:0.0:1787791101.993738:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791101.993809:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 17 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.993820:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 17 pid: 22695 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.993828:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268180224:0@lo:104: 00000100:00100000:0.0:1787791101.993850:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.993877:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e0c1cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791101.993936:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180096 00000100:00100000:0.0:1787791101.993944:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180096 00000100:00100000:0.0:1787791101.993990:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180224 00000100:00100000:0.0:1787791101.993992:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180224 00000100:00100000:0.0:1787791101.994014:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791101.994023:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268180096:12345-0@lo:104: 00010000:00010000:0.0:1787791101.994038:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994108:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787791101.994115:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268180096:12345-0@lo:104: Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.994123:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791101.994145:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791101.994151:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268180224:12345-0@lo:104: 00010000:00010000:0.0:1787791101.994159:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994194:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787791101.994200:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268180224:12345-0@lo:104: Request processed in 49us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.994206:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787791101.994227:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791101.994234:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994242:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3a00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791101.994246:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994256:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791101.994263:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.994269:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791101.994307:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994313:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791101.994338:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994344:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d3a00/0xcf9477fddcf1f532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f539 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994356:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791101.994359:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994364:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170c165fe00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791101.994366:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994372:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791101.994377:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791101.994382:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791101.994395:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994401:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791101.994407:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994422:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170c165fe00/0xcf9477fddcf1f46e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f475 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994437:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791101.994439:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791101.994440:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791101.994448:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791101.994472:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268180352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791101.994504:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.994526:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791101.994531:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268180480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791101.994549:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791101.994575:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180352 00000100:00100000:0.0:1787791101.994580:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180352 00010000:00010000:0.0:1787791101.994597:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 18 pid: 22693 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.994619:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180480 00000100:00100000:0.0:1787791101.994622:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180480 00010000:00010000:0.0:1787791101.994633:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 19 pid: 22695 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.994646:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791101.994652:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:3638:x1874634268180352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791101.994664:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791101.994669:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 19 pid: 22693 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994691:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 19 pid: 22693 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994747:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791101.994775:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:3638:x1874634268180352:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.994782:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791101.994796:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791101.994802:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3638:x1874634268180480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791101.994809:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791101.994813:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 18 pid: 22695 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994822:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 18 pid: 22695 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994834:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994843:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787791101.994871:0:22685:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001832348s 00010000:00010000:0.0:1787791101.994876:0:22685:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994883:0:22685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994899:0:22685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994906:0:22685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994911:0:22685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791101.994916:0:22685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994923:0:22685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994931:0:22685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.994939:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791101.994963:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3638:x1874634268180480:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791101.994968:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791101.995125:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268180480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791101.995135:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a561c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268180352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791101.995167:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f532 expref: 17 pid: 22693 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.995177:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268180096:0@lo:104: 00010000:00010000:0.0:1787791101.995185:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f46e expref: 16 pid: 22695 timeout: 750 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791101.995201:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268180224:0@lo:104: 00010000:00010000:0.0:1787791101.995215:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.995225:0:22716:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.995231:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791101.995237:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9e600/0xcf9477fddcf1f571 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1787791102.015074:0:23433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787791102.015306:0:23457:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787791102.015312:0:23457:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787791102.015594:0:23458:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787791102.016269:0:23458:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787791102.016901:0:23433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787791102.017270:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180608:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787791102.017358:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791102.017409:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180608 00000100:00100000:0.0:1787791102.017416:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180608 00000100:00100000:0.0:1787791102.017466:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787791102.017493:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180608:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787791102.017574:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180608:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791102.017582:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:1.0:1787791102.018340:0:23433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1787791102.018380:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791102.018414:0:23458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787791102.018475:0:23458:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1787791102.018904:0:23433:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787791102.018914:0:23433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1787791102.018964:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787791102.019747:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787791102.019804:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180608:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787791102.019852:0:23459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787791102.019952:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787791102.020043:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791102.020092:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791102.020107:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180736 00000100:00100000:2.0:1787791102.020114:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180736 00000100:00100000:2.0:1787791102.020162:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787791102.020174:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180736:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787791102.020340:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180736:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 166us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791102.020348:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791102.020357:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180736:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787791102.020427:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23459:1874634268180864:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787791102.020463:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791102.020552:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791102.020602:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180864 00000100:00100000:2.0:1787791102.020607:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180864 00000100:00100000:2.0:1787791102.020643:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791102.020651:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1874634268180864:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787791102.020725:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1874634268180864:12345-0@lo:900:lod0001_rec0000.0 Request processed in 55us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791102.020733:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787791102.020752:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3a56580 x1874634268180864/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787791118 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791102.020765:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a56580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23459:1874634268180864:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787791102.020830:0:23459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180992:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787791102.020875:0:23459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791102.020903:0:23459:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791102.020915:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268180992 00000100:00100000:2.0:1787791102.020920:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268180992 00000100:00100000:2.0:1787791102.020945:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787791102.020959:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180992:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787791102.021104:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23459:x1874634268180992:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 145us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791102.021111:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787791102.021198:0:23459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23459:1874634268180992:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787791102.021250:0:23459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787791102.023237:0:23433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787791102.025804:0:23433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787791102.025922:0:23433:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1787791102.026236:0:23433:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787791102.027236:0:23459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787791102.027336:0:23459:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787791102.027343:0:23459:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:0.0:1787791102.029093:0:23433:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1787791102.031328:0:23433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1787791102.042265:0:23433:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787791102.042320:0:23433:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa8b3015df988 00100000:10000000:0.0:1787791102.042331:0:23433:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1787791102.043202:0:23433:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787791102.043246:0:23433:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787791102.043271:0:23433:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787791102.043296:0:23433:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787791102.049846:0:23433:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787791102.050116:0:23433:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787791102.348225:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:0.0:1787791102.860173:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791103.051512:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787791103.371422:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 10000000:01000000:2.0:1787791103.631197:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787791103.631209:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce838000 from 12 10000000:01000000:2.0:1787791103.631216:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791103.631277:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.631290:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.631303:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791103.631333:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791103.631429:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791103.631481:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c83f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787791103.632972:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181120 00000100:00100000:1.0:1787791103.632991:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181120 00000100:00100000:1.0:1787791103.633076:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787791103.633090:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:22697:x1874634268181120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787791103.633114:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791103.633139:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f578 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791103.633186:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791103.633200:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791103.633213:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d5a00, rc 0) 00000100:00100000:1.0:1787791103.633333:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268181120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791103.633341:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787791103.633494:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791103.633517:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.633529:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791103.633607:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787791103.633673:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791103.633961:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c83f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787791103.634176:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181248 00000100:00100000:3.0:1787791103.634183:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181248 00000100:00100000:1.0:1787791103.634402:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787791103.634412:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268181248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787791103.634435:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787791103.634458:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787791103.634462:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1787791103.634577:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268181248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791103.634585:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787791103.636428:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787791103.636516:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787791103.636530:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.636542:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791103.636555:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787791103.636558:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f39e2000 from 12 10000000:01000000:2.0:1787791103.636561:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791103.636605:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.636614:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.636624:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791103.636660:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791103.636768:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791103.637115:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c83f7000 going to sleep for 11 seconds 00000100:00100000:3.0:1787791103.637284:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181376 00000100:00100000:3.0:1787791103.637292:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181376 00000100:00100000:3.0:1787791103.637346:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787791103.637357:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268181376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791103.637376:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791103.637394:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f586 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791103.637425:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 18 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791103.637437:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 18 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791103.637447:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26faa00, rc 0) 00000100:00100000:3.0:1787791103.637511:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268181376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791103.637518:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787791103.641283:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791103.641325:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.641370:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791103.641470:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787791103.641564:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791103.641628:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c83f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787791103.641674:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181504 00000100:00100000:2.0:1787791103.641822:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181504 00000100:00100000:2.0:1787791103.641891:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787791103.641902:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268181504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787791103.641930:0:22695:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787791103.641954:0:22695:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787791103.641958:0:22695:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787791103.642080:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268181504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791103.642089:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787791103.642137:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268181504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787791103.642184:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787791103.642192:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.642201:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791103.884118:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791104.076447:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787791104.394795:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:0.0:1787791104.909981:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791105.418951:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00010000:00010000:0.0:1787791105.931384:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791106.443957:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 0 seconds 00000001:02000400:3.0:1787791106.847071:0:23701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787791106.960986:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791107.405674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787791107.405681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787791107.405685:0:8:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787791107.405697:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff916fc393a800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791107.406146:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3764b40 x1874634268181888/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787791107.406164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791107.406167:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791107.406169:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791107.406172:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791107.406199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791107.406202:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791107.406205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791107.406208:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787791107.406288:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268181632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791107.406360:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.406421:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268182272:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.406459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.406484:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787791107.406490:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268181760:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.406528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.406566:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268182016:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.406591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.406608:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791107.406614:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268182144:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.406634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.406748:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181632 00000100:00100000:0.0:1787791107.406755:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181632 00000100:00100000:0.0:1787791107.406792:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182144 00000100:00100000:0.0:1787791107.406795:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182144 00000100:00100000:0.0:1787791107.406819:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787791107.406829:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268181632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787791107.406868:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787791107.406918:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268181632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791107.406925:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787791107.406943:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787791107.406950:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268182144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.406992:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268182144:12345-0@lo:400:kworker.0 Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791107.406999:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787791107.407016:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182272 00000100:00100000:0.0:1787791107.407019:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182272 00000100:00100000:0.0:1787791107.407042:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182016 00000100:00100000:0.0:1787791107.407045:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182016 00000100:00100000:0.0:1787791107.407057:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791107.407062:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.407101:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268182272:12345-0@lo:400:kworker.0 Request processed in 39us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791107.407108:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791107.407119:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787791107.407125:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.407150:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268182016:12345-0@lo:400:kworker.0 Request processed in 25us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791107.407156:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787791107.407172:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181760 00000100:00100000:0.0:1787791107.407176:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181760 00000100:00100000:0.0:1787791107.407202:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787791107.407208:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3640:x1874634268181760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.407235:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3640:x1874634268181760:12345-0@lo:400:kworker.0 Request processed in 27us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791107.407240:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787791107.407286:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268181760:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.407303:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268181632:0@lo:41:osp-pre-0-1.0 00010000:00080000:0.0:1787791107.407314:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3765680 x1874634268182272/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791107.407324:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268182272:0@lo:400:kworker.0 00000100:00100000:0.0:1787791107.407356:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268182144:0@lo:400:kworker.0 00010000:00080000:0.0:1787791107.407366:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3764f00 x1874634268182016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791107.407388:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268182016:0@lo:400:kworker.0 00000100:00100000:2.0:1787791107.408847:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268181888:0@lo:38:kworker.0 00000100:00100000:2.0:1787791107.408906:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791107.410654:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268181888 00000100:00100000:1.0:1787791107.410667:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268181888 00000100:00100000:1.0:1787791107.410702:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791107.410722:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1874634268181888:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787791107.410753:0:22705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:1.0:1787791107.410788:0:22705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f594 00000004:00100000:1.0:1787791107.410817:0:22705:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787791107.410829:0:22705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1787791107.430579:0:22705:0:(import.c:65:import_set_state_nolock()) ffff9170c759a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787791107.430803:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268181888:12345-0@lo:38:kworker.0 Request processed in 20079us (21894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791107.430826:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787791107.431035:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787791107.431047:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787791107.431053:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787791107.431056:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc393a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787791107.431117:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002448f0ac): req@ffff916fc3b93c00 x1874634268174848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791107.431140:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268181888:0@lo:38:kworker.0 00000100:00100000:0.0:1787791107.431242:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.431273:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3a1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787791107.431311:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268174848 00000100:00100000:2.0:1787791107.431318:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268174848 00000100:00100000:2.0:1787791107.431363:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787791107.431372:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268174848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787791107.431564:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268174848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 193us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791107.431572:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787791107.431629:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22742:1874634268174848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1787791107.431665:0:22742:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787791107.431740:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22742:1874634268182400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787791107.431771:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.431795:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787791107.431853:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182400 00000100:00100000:3.0:1787791107.431857:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182400 00000100:00100000:3.0:1787791107.431883:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787791107.431888:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268182400:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787791107.432005:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268182400:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791107.432012:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787791107.432124:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22742:1874634268182400:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787791107.432187:0:22742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22742:1874634268182528:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787791107.432211:0:22742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791107.432234:0:22742:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787791107.432273:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182528 00000100:00100000:3.0:1787791107.432277:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182528 00000100:00100000:3.0:1787791107.432295:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787791107.432301:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268182528:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787791107.432356:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22742:x1874634268182528:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791107.432362:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787791107.432417:0:22742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22742:1874634268182528:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1787791107.432473:0:22742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787791107.436261:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787791107.436288:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268182656:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787791107.436330:0:22742:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000100:00100000:3.0:1787791107.436367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787791107.436392:0:22742:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:0.0:1787791107.436396:0:22742:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1787791107.436621:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182656 00000100:00100000:1.0:1787791107.436629:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182656 00000100:00100000:1.0:1787791107.436685:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787791107.436696:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268182656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787791107.436766:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787791107.436839:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874634268182656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791107.436847:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787791107.436969:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268182656:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787791107.651115:0:23754:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787791107.651316:0:23754:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787791107.981032:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787791108.701271:0:23804:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787791108.701487:0:23804:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787791109.002983:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787791109.462772:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1787791109.834732:0:23852:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef152b800 20000000:00000080:1.0:1787791109.834757:0:23852:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170edfd5400 uarg=0000000000000000 20000000:01000000:1.0:1787791109.834828:0:23852:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787791109.834838:0:23852:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787791109.834846:0:23852:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787791109.843056:0:23853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787791109.843163:0:23852:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787791109.853537:0:23852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787791109.853811:0:23852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.853838:0:23852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 17 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.853845:0:23852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.853854:0:23852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.853919:0:23852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.853949:0:23852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791109.853967:0:23852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23852:1874634268182784:0@lo:104: 00000100:00100000:2.0:1787791109.854062:0:23852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787791109.854126:0:23852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 17 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.854135:0:23852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 17 pid: 22695 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791109.854143:0:23852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23852:1874634268182912:0@lo:104: 00000100:00100000:2.0:1787791109.854178:0:23852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791109.854219:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182784 00000100:00100000:0.0:1787791109.854460:0:22683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268182912 00000100:00100000:0.0:1787791109.854472:0:22683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182912 00000100:00100000:0.0:1787791109.854534:0:22683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787791109.854545:0:22683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:23852:x1874634268182912:12345-0@lo:104: 00010000:00010000:0.0:1787791109.854561:0:22683:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.854644:0:22683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787791109.854651:0:22683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:23852:x1874634268182912:12345-0@lo:104: Request processed in 108us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791109.854659:0:22683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791109.854663:0:23852:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87540 going to sleep for 11 seconds 00000100:00100000:3.0:1787791109.854728:0:23852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23852:1874634268182912:0@lo:104: 00010000:00010000:1.0:1787791109.854747:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791109.854755:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.854764:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791109.854768:0:22689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.854777:0:22689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791109.854794:0:22689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791109.854807:0:22689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787791109.854853:0:22689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.854860:0:22689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791109.854891:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.854899:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d4e00/0xcf9477fddcf1f43d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f444 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.854911:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791109.854913:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791109.854915:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791109.854931:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787791109.854945:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268183040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791109.854992:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791109.855034:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268182784 00000100:00100000:2.0:1787791109.855072:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787791109.855081:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:23852:x1874634268182784:12345-0@lo:104: 00010000:00010000:2.0:1787791109.855090:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791109.855127:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787791109.855133:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:23852:x1874634268182784:12345-0@lo:104: Request processed in 54us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791109.855139:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787791109.855147:0:23852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23852:1874634268182784:0@lo:104: 00010000:00010000:3.0:1787791109.855169:0:23852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855213:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791109.855218:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855239:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2800 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791109.855242:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855250:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791109.855256:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791109.855262:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787791109.855287:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855293:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791109.855313:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855321:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2800/0xcf9477fddcf1f540 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f547 expref: -99 pid: 23433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791109.855348:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791109.855350:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791109.855352:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791109.855356:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791109.855366:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268183168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791109.855395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791109.856024:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183040 00000100:00100000:1.0:1787791109.856032:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183040 00010000:00010000:1.0:1787791109.856058:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 18 pid: 22695 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791109.856083:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183168 00000100:00100000:1.0:1787791109.856086:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183168 00010000:00010000:1.0:1787791109.856100:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 19 pid: 22694 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791109.856113:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787791109.856121:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:3639:x1874634268183040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791109.856134:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791109.856140:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 19 pid: 22695 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856164:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 19 pid: 22695 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856181:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f43d expref: 19 pid: 22695 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856198:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791109.856259:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3639:x1874634268183040:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791109.856266:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787791109.856286:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787791109.856292:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:3638:x1874634268183168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791109.856300:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791109.856305:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856314:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856324:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb200/0xcf9477fddcf1f547 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f540 expref: 17 pid: 22694 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856336:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856346:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856363:0:22686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856379:0:22686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856387:0:22686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856395:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856401:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791109.856406:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856414:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856436:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791109.856447:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791109.856484:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:3638:x1874634268183168:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791109.856491:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787791109.856526:0:23852:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791109.856526:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268183168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787791109.856534:0:23852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791109.856540:0:23852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f59b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791109.856939:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268183040:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791110.027115:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791111.055752:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791111.501931:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791101/real 1787791101] req@ffff916fc3b930c0 x1874634268178048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791111.501968:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3b930c0 x1874634268178048/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791111.501978:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791101/real 1787791101] req@ffff916fc3766d00 x1874634268177792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791111.501988:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3766d00 x1874634268177792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787791111.502010:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791111.502023:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791111.502027:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268178048:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787791111.502034:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791111.504229:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791111.504245:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268177792:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787791111.506964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791111.506974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791111.506977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791111.506982:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791111.507016:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791111.507019:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:0.0:1787791111.507029:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268183296:0@lo:400:kworker.0 00000100:00080000:3.0:1787791111.507044:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791111.507050:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:3.0:1787791111.507056:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787791111.507065:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170f3c46000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791111.507091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e47f4b40 x1874634268183808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787791111.507107:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791111.507111:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787791111.507112:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791111.507116:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:3.0:1787791111.507119:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787791111.507122:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170c7da2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791111.507133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.507135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170c9968b40 x1874634268183936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791111.507177:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268183424:0@lo:400:kworker.0 00000100:00100000:0.0:1787791111.507187:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268184064:0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.507213:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791111.507213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791111.507251:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183296 00000100:00100000:0.0:1787791111.507259:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183296 00000100:00100000:0.0:1787791111.507314:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787791111.507324:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:3640:x1874634268183296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.508946:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268183552:0@lo:400:kworker.0 00000100:00100000:1.0:1787791111.508950:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268183808:0@lo:8:kworker.0 00000100:00100000:0.0:1787791111.509982:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:3640:x1874634268183296:12345-0@lo:400:kworker.0 Request processed in 2653us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791111.509997:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787791111.510066:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184064 00000100:00100000:0.0:1787791111.510076:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184064 00000100:00100000:0.0:1787791111.510125:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787791111.510134:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268184064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791111.510190:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268184064:12345-0@lo:400:kworker.0 Request processed in 58us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791111.510197:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787791111.510262:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170e4d5b480 x1874634268184064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791111.510278:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268184064:0@lo:400:kworker.0 00000100:00100000:0.0:1787791111.510292:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268183296:0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.510494:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.511603:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787791111.511623:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268183680:0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.511682:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.511757:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183424 00000100:00100000:3.0:1787791111.511764:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183424 00000100:00100000:3.0:1787791111.511817:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183680 00000100:00100000:3.0:1787791111.511821:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183680 00000100:00100000:3.0:1787791111.511838:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787791111.512002:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268183424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.512067:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3641:x1874634268183424:12345-0@lo:400:kworker.0 Request processed in 214us (4853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791111.512075:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787791111.512095:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787791111.512102:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268183680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.512132:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268183680:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791111.512138:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787791111.512179:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268183424:0@lo:400:kworker.0 00000100:00100000:3.0:1787791111.512211:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268183680:0@lo:400:kworker.0 00000400:00000100:1.0:1787791111.513062:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268183808 offset 0 length 520: 4 00000100:00100000:1.0:1787791111.513114:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268183936:0@lo:8:kworker.0 00000400:00000100:1.0:1787791111.513167:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268183936 offset 0 length 520: 4 00000100:00100000:0.0:1787791111.514887:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268183552 00000100:00100000:0.0:1787791111.514906:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268183552 00000100:00100000:0.0:1787791111.515414:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791111.515427:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268183552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791111.515617:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268183552:12345-0@lo:400:kworker.0 Request processed in 193us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791111.515626:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787791111.519080:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170e47f5e00 x1874634268183552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791111.519108:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268183552:0@lo:400:kworker.0 10000000:01000000:2.0:1787791111.883385:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787791111.883397:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce838000 from 13 10000000:01000000:2.0:1787791111.883404:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787791111.883470:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791111.883484:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791111.883498:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791111.883531:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.883637:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791111.883850:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87780 going to sleep for 11 seconds 00000100:00100000:1.0:1787791111.883946:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184192 00000100:00100000:1.0:1787791111.883956:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184192 00000100:00100000:1.0:1787791111.884021:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787791111.884032:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+16:22697:x1874634268184192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787791111.884061:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791111.884081:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f5a2 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791111.884110:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791111.884124:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 17 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791111.884134:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4e00, rc 0) 00000100:00100000:1.0:1787791111.884196:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791111.884204:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787791111.884296:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37670c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791111.884315:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.884325:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791111.884405:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791111.884435:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.884467:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791111.884520:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184320 00000100:00100000:2.0:1787791111.884523:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184320 00000100:00100000:2.0:1787791111.884557:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787791111.884564:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.884853:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791111.884860:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787791111.884931:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791111.884966:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787791111.885010:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.885041:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791111.885080:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184448 00000100:00100000:2.0:1787791111.885083:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184448 00000100:00100000:2.0:1787791111.885172:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787791111.885179:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.885258:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791111.885264:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787791111.885528:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787791111.889985:0:23972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787791111.890409:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787791111.890444:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787791111.890460:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.890475:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791111.890488:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787791111.890491:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f39e2000 from 13 10000000:01000000:3.0:1787791111.890494:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787791111.890545:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.890554:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.890568:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791111.890599:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787791111.890794:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.890851:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791111.890927:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184576 00000100:00100000:2.0:1787791111.890936:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184576 00000100:00100000:2.0:1787791111.890990:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787791111.891000:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+17:22697:x1874634268184576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791111.891016:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791111.891032:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f5b0 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791111.891113:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 18 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791111.891126:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 18 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791111.891151:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2400, rc 0) 00000100:00100000:2.0:1787791111.891205:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268184576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791111.891212:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787791111.892100:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791111.892128:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.892158:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791111.892241:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791111.892286:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791111.892324:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d00eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791111.892389:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184704 00000100:00100000:2.0:1787791111.892394:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184704 00000100:00100000:2.0:1787791111.892435:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787791111.892443:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268184704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.892577:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268184704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791111.892584:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787791111.892617:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.892752:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.892808:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791111.892821:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3f87cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791111.892925:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184832 00000100:00100000:2.0:1787791111.892929:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184832 00000100:00100000:2.0:1787791111.892944:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787791111.892950:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268184832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791111.893025:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:22697:x1874634268184832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791111.893033:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787791111.893196:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268184832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787791111.899588:0:23973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787791111.901630:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787791111.901684:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787791111.901729:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791111.901747:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791112.080226:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791112.522922:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791097/real 1787791097] req@ffff916fc37661c0 x1874634268175872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791112.522962:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc37661c0 x1874634268175872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791112.522973:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791097/real 1787791097] req@ffff916fc3765a40 x1874634268176000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791112 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791112.522985:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3765a40 x1874634268176000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791112 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787791112.523009:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791112.523026:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791112.523030:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268175872:0@lo:8:kworker.0 00000100:00080000:0.0:1787791112.523037:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791112.523042:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791112.523045:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268176000:0@lo:8:kworker.0 00000100:00080000:1.0:1787791112.523231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791112.523236:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787791112.523240:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791112.523246:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:1.0:1787791112.523253:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787791112.523262:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170f5039000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791112.523285:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b92d00 x1874634268185344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791112.523318:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791112.523321:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787791112.523323:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791112.523326:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 646 00000100:00080000:1.0:1787791112.523329:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787791112.523333:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170f3c7e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791112.523345:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b91e00 x1874634268185472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791112.523364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791112.523368:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787791112.523371:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791112.523375:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787791112.523404:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268185600:0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.523677:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268185088:0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.523768:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791112.523818:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268185856:0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.523850:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791112.523876:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787791112.523882:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268185216:0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.523910:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791112.523943:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185088 00000100:00100000:2.0:1787791112.523951:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185088 00000100:00100000:2.0:1787791112.524004:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787791112.524013:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3638:x1874634268185088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.524075:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:3638:x1874634268185088:12345-0@lo:400:kworker.0 Request processed in 62us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791112.524083:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787791112.524121:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185856 00000100:00100000:2.0:1787791112.524125:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185856 00000100:00100000:2.0:1787791112.524155:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787791112.524161:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268185856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.524195:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268185856:12345-0@lo:400:kworker.0 Request processed in 34us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791112.524201:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787791112.524242:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268185088:0@lo:400:kworker.0 00010000:00080000:2.0:1787791112.524255:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3b90f00 x1874634268185856/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791112.524268:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268185856:0@lo:400:kworker.0 00000100:00100000:1.0:1787791112.524371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791112.524405:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787791112.524412:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268184960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791112.524443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791112.524458:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268185728:0@lo:400:kworker.0 00000100:00100000:1.0:1787791112.524639:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791112.524670:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268185344:0@lo:8:kworker.0 00000400:00000100:1.0:1787791112.524699:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268185344 offset 0 length 520: 4 00000100:00100000:1.0:1787791112.524745:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268185472:0@lo:8:kworker.0 00000400:00000100:1.0:1787791112.524789:0:3637:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874634268185472 offset 0 length 520: 4 00000100:00100000:3.0:1787791112.524987:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185216 00000100:00100000:3.0:1787791112.524994:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185216 00000100:00100000:3.0:1787791112.525027:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268184960 00000100:00100000:3.0:1787791112.525030:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268184960 00000100:00100000:3.0:1787791112.525044:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185728 00000100:00100000:3.0:1787791112.525046:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185728 00000100:00100000:3.0:1787791112.525056:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787791112.525064:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268185216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791112.525166:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268185216:12345-0@lo:400:kworker.0 Request processed in 102us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791112.525174:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787791112.525190:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787791112.525195:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268184960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787791112.525238:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787791112.525279:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874634268184960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791112.525284:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787791112.525295:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787791112.525300:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268185728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791112.525320:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268185728:12345-0@lo:400:kworker.0 Request processed in 20us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791112.525325:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787791112.525358:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268184960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787791112.525366:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268185728:0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.525615:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185600 00000100:00100000:2.0:1787791112.525620:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185600 00000100:00100000:2.0:1787791112.525653:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787791112.525659:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268185600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791112.525724:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268185600:12345-0@lo:400:kworker.0 Request processed in 46us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791112.525730:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787791112.525781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3b91a40 x1874634268185600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791112.525792:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268185600:0@lo:400:kworker.0 00000100:00100000:3.0:1787791112.526956:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268185984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791112.527026:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791112.527773:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268185216:0@lo:400:kworker.0 00000100:00100000:1.0:1787791112.527930:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268185984 00000100:00100000:1.0:1787791112.527938:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268185984 00000100:00100000:1.0:1787791112.528044:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787791112.528057:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268185984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787791112.528107:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787791112.528246:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268185984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 191us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791112.528254:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787791112.528349:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268185984:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1787791113.042994:0:23434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787791113.099155:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791114.123732:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787791114.315623:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787791115.149068:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787791115.250223:0:24201:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787791115.250228:0:24201:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1787791115.250229:0:24201:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787791115.250363:0:24201:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170c7da0000 00000020:01000004:0.0:1787791115.250385:0:24201:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787791115.250405:0:24201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787791115.250420:0:24201:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff916fc34a99b8) 00000020:00000080:0.0:1787791115.250439:0:24201:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787791115.316983:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787791115.319072:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787791115.319599:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787791115.319866:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787791115.320110:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787791115.320659:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787791115.321505:0:24201:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:1.0:1787791115.324571:0:24201:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787791115.324967:0:24201:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787791115.324984:0:24201:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787791115.324998:0:24201:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1f5c5 00000020:01000004:1.0:1787791115.325005:0:24201:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787791115.325029:0:24201:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787791115.325033:0:24201:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787791115.325040:0:24201:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787791115.325045:0:24201:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787791115.325057:0:24201:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff916fc320cd28) 00000020:00000080:1.0:1787791115.325068:0:24201:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787791115.326385:0:24201:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791115.326571:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787791115.326578:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787791115.331222:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787791115.331235:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787791115.331671:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787791115.331678:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787791115.334838:0:24201:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787791115.335267:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787791115.335278:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787791115.341400:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787791115.341416:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787791115.361887:0:24201:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787791115.362151:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787791115.362158:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787791115.365582:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787791115.365596:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787791115.366819:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787791115.366831:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787791115.368617:0:24201:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787791115.368909:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787791115.368914:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787791115.369517:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787791115.369524:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787791115.402195:0:24201:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787791115.402423:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787791115.402429:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787791115.403861:0:24201:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787791115.403958:0:24201:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787791115.404445:0:24201:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787791115.404481:0:24201:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787791115.404488:0:24201:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787791115.417155:0:24201:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787791115.417203:0:24201:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787791115.417208:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787791115.417210:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787791115.417212:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791115.417213:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791115.417214:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791115.417215:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791115.417217:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791115.417219:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791115.417220:0:24201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791115.417224:0:24201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787791115.417227:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787791115.417228:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787791115.417229:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791115.417230:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791115.417231:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791115.417232:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791115.417233:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791115.417241:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791115.417242:0:24201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791115.417273:0:24201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787791115.417295:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186112:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787791115.417448:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.417562:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791115.417607:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186112 00000100:00100000:3.0:1787791115.417615:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186112 00000100:00100000:3.0:1787791115.417751:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787791115.417762:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:24201:x1874634268186112:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787791115.417805:0:22694:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787791115.417809:0:22694:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787791115.417813:0:22694:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787791115.418206:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:24201:x1874634268186112:12345-0@lo:253:mount.lustre.0 Request processed in 444us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.418216:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787791115.418294:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787791115.418311:0:24201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787791115.418313:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787791115.418315:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787791115.418316:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791115.418317:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791115.418318:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791115.418319:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791115.418320:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791115.418322:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791115.418323:0:24201:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787791115.418343:0:24201:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170c7da0000 from lustre-OST0000 10000000:01000000:0.0:1787791115.418372:0:24201:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787791115.418375:0:24201:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787791115.418384:0:24201:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff916fc45f99b8 local copy 00010000:00010000:0.0:1787791115.418394:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.418488:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791115.418520:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.419479:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787791115.419553:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186240 00000100:00100000:2.0:1787791115.419560:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186240 00000100:00100000:2.0:1787791115.419600:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787791115.419610:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:24201:x1874634268186240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791115.419827:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:24201:x1874634268186240:12345-0@lo:501:mount.lustre.0 Request processed in 218us (1306us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787791115.419835:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787791115.420035:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186240:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787791115.420055:0:24201:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787791115.420080:0:24201:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787791115.420088:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.420105:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791115.420138:0:24201:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170c7da0000 10000000:01000000:0.0:1787791115.420143:0:24201:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787791115.420149:0:24201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787791115.420152:0:24201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787791115.420157:0:24201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787791115.420160:0:24201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787791115.420190:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.420198:0:24201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.420206:0:24201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.420223:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186368:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791115.420257:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.420402:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787791115.420439:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186368 00000100:00100000:2.0:1787791115.420443:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186368 00000100:00100000:2.0:1787791115.420505:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787791115.420513:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+18:24201:x1874634268186368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791115.420522:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791115.420537:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f5da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f5d3 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791115.420558:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5d3 expref: 19 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791115.420569:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2600/0xcf9477fddcf1f5da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5d3 expref: 19 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791115.420577:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2600, rc 0) 00000100:00100000:2.0:1787791115.420660:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186368:12345-0@lo:101:mount.lustre.0 Request processed in 148us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791115.420667:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787791115.420808:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791115.420823:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5da expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.420832:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f5da expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787791115.428930:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787791115.430063:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787791115.432150:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787791115.432207:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787791115.432224:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787791115.432236:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787791115.432247:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787791115.432258:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787791115.432269:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787791115.432280:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787791115.432292:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787791115.432304:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787791115.432315:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787791115.432326:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787791115.432348:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787791115.432353:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787791115.432461:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791115.432532:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.432640:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791115.437102:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186496 00000100:00100000:3.0:1787791115.437123:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186496 00000100:00100000:3.0:1787791115.437243:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787791115.437255:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791115.437483:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186496:12345-0@lo:501:mount.lustre.0 Request processed in 229us (4950us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.437491:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787791115.437575:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791115.437645:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791115.437694:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.446148:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82600 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.446304:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186624 00000100:00100000:0.0:1787791115.446315:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186624 00000100:00100000:0.0:1787791115.446370:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787791115.446456:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791115.449753:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186624:12345-0@lo:503:mount.lustre.0 Request processed in 3278us (12037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.449769:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787791115.449927:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787791115.451009:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787791115.451102:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.451356:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.451474:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82000 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.451576:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186752 00000100:00100000:0.0:1787791115.451584:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186752 00000100:00100000:0.0:1787791115.451623:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787791115.451633:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.452170:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186752:12345-0@lo:502:mount.lustre.0 Request processed in 537us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.452178:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787791115.452495:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787791115.452746:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787791115.452779:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787791115.452796:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787791115.452817:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787791115.452830:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787791115.452843:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787791115.452857:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787791115.452871:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787791115.453462:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787791115.453489:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787791115.453504:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787791115.453518:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787791115.453555:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.453620:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.453761:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82000 going to sleep for 11 seconds 00000100:00100000:2.0:1787791115.454836:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268186880 00000100:00100000:2.0:1787791115.454846:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268186880 00000100:00100000:3.0:1787791115.457351:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787791115.457387:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791115.457755:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268186880:12345-0@lo:502:mount.lustre.0 Request processed in 389us (4134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.457764:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787791115.458079:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268186880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787791115.458251:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787791115.458275:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787791115.464115:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787791115.464129:0:24218:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787791115.464137:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787791115.464140:0:24218:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787791115.464152:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787791115.464185:0:24218:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9170f52fcd28) 00000020:00000080:2.0:1787791115.464222:0:24218:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787791115.464231:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787791115.464316:0:24218:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170c7da0000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787791115.464326:0:24218:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787791115.464333:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf9477fddcf1f5e8 00010000:00010000:2.0:1787791115.475370:0:24218:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1787791115.479623:0:24218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787791115.481999:0:24218:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787791115.483945:0:24218:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787791115.483958:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791115.483966:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.483968:0:24218:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787791115.483972:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787791115.483974:0:24218:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1787791115.483976:0:24218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787791115.483977:0:24218:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787791115.483979:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787791115.483981:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.483983:0:24218:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787791115.483985:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791115.483999:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.484001:0:24218:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787791115.484005:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787791115.484007:0:24218:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787791115.484009:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791115.484011:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.484012:0:24218:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787791115.484015:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791115.484017:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.484018:0:24218:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787791115.484021:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787791115.484047:0:24218:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791115.484051:0:24218:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791115.484052:0:24218:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787791115.484055:0:24218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1787791115.485683:0:24201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787791115.485760:0:24201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787791115.485790:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5da expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.485812:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9f600/0xcf9477fddcf1f5d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5da expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791115.485822:0:24201:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c7da0000 from 1 10000000:01000000:1.0:1787791115.485825:0:24201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787791115.485868:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.485876:0:24201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.485897:0:24201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791115.485923:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787791115.485993:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.486033:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.487949:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187008 00000100:00100000:0.0:1787791115.487962:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187008 00000100:00100000:0.0:1787791115.488026:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787791115.488037:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268187008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791115.488052:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791115.488071:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f5ef expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.488101:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 20 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.488113:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 20 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.488122:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ec00, rc 0) 00000100:00100000:0.0:1787791115.488193:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187008:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.488200:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787791115.488947:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791115.488968:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.488979:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787791115.490839:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1787791115.491280:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787791115.492064:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1787791115.492096:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1787791115.492109:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1787791115.492123:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1787791115.492137:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1787791115.492152:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1787791115.492167:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1787791115.492183:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1787791115.492984:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1787791115.493016:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1787791115.493031:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1787791115.493055:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1787791115.493061:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1787791115.493169:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791115.493240:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.493412:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791115.500490:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187136 00000100:00100000:2.0:1787791115.500505:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187136 00000100:00100000:2.0:1787791115.502065:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787791115.502085:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791115.502429:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187136:12345-0@lo:501:mount.lustre.0 Request processed in 350us (9188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791115.502437:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787791115.502613:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787791115.502666:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791115.502747:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.511423:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.512517:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187264 00000100:00100000:0.0:1787791115.512531:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187264 00000100:00100000:3.0:1787791115.512820:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787791115.512833:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791115.513012:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187264:12345-0@lo:503:mount.lustre.0 Request processed in 182us (10275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.513020:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787791115.513129:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787791115.513592:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787791115.513688:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.513779:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.516922:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.519480:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187392 00000100:00100000:0.0:1787791115.519495:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187392 00000100:00100000:0.0:1787791115.519563:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787791115.519574:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.519789:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187392:12345-0@lo:502:mount.lustre.0 Request processed in 216us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.519798:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787791115.523068:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787791115.523352:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787791115.523385:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787791115.523401:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787791115.523414:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787791115.523427:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787791115.523441:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787791115.523454:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787791115.523466:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787791115.523478:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787791115.523491:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787791115.523505:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787791115.523542:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.523613:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.523652:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.527821:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187520 00000100:00100000:0.0:1787791115.527837:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187520 00000100:00100000:0.0:1787791115.527895:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787791115.527905:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.528098:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187520:12345-0@lo:502:mount.lustre.0 Request processed in 194us (4484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.528105:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787791115.528314:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787791115.528406:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787791115.528421:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787791115.530323:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791115.530338:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530342:0:24222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787791115.530349:0:24222:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170c7da0000 00000020:00000080:1.0:1787791115.530352:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787791115.530360:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791115.530362:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530363:0:24222:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787791115.530366:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791115.530369:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530370:0:24222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787791115.530386:0:24222:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170c7da0000 00000020:00000080:1.0:1787791115.530389:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787791115.530451:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791115.530455:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530456:0:24222:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787791115.530459:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791115.530461:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530462:0:24222:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787791115.530466:0:24222:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170c7da0000 00000020:00000080:1.0:1787791115.530468:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787791115.530487:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791115.530490:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530491:0:24222:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787791115.530494:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787791115.530496:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530497:0:24222:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787791115.530501:0:24222:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170c7da0000 00000020:00000080:1.0:1787791115.530502:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787791115.530524:0:24222:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787791115.530526:0:24222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787791115.530527:0:24222:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787791115.530530:0:24222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787791115.530668:0:24201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787791115.530693:0:24201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787791115.530751:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.530763:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791115.530815:0:24201:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787791115.530818:0:24201:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170c7da0000 10000000:01000000:0.0:1787791115.530821:0:24201:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170c7da0000 10000000:01000000:0.0:1787791115.530825:0:24201:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787791115.530831:0:24201:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170c7da0000 from 1 10000000:01000000:0.0:1787791115.530833:0:24201:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787791115.530872:0:24201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.530892:0:24201:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.530903:0:24201:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.530928:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791115.530995:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.531034:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.531058:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187648 00000100:00100000:0.0:1787791115.531064:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187648 00000100:00100000:0.0:1787791115.531106:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787791115.531115:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:24201:x1874634268187648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791115.531128:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791115.531141:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1f604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f5fd expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.531279:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1f604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5fd expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.531291:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9e800/0xcf9477fddcf1f604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5fd expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.531299:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e800, rc 0) 00000100:00100000:0.0:1787791115.531343:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268187648:12345-0@lo:101:mount.lustre.0 Request processed in 229us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.531350:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787791115.531431:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791115.531446:0:24201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f604 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.531456:0:24201:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f604 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787791115.541902:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787791115.542272:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787791115.542522:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787791115.542546:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787791115.542561:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787791115.542574:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787791115.542585:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787791115.542597:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787791115.542610:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787791115.542623:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787791115.542636:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787791115.542649:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787791115.542662:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787791115.542676:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787791115.542690:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787791115.542732:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787791115.542780:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787791115.542807:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787791115.542822:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787791115.542835:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787791115.542848:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787791115.542861:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787791115.542874:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787791115.542886:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787791115.542899:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787791115.542914:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787791115.542928:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787791115.542943:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787791115.542956:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787791115.542971:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787791115.542983:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787791115.542996:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787791115.543010:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787791115.543044:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787791115.543061:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787791115.543075:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787791115.543090:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787791115.543103:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787791115.543114:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787791115.543126:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787791115.543140:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787791115.543155:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787791115.543169:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787791115.543182:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787791115.543197:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787791115.543209:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787791115.543223:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787791115.543236:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787791115.543249:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787791115.543275:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787791115.543379:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787791115.543398:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787791115.543422:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787791115.543427:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787791115.543519:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791115.543584:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.543629:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787791115.543850:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187776 00000100:00100000:2.0:1787791115.543859:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187776 00000100:00100000:2.0:1787791115.544245:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787791115.544257:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268187776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791115.544384:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268187776:12345-0@lo:501:mount.lustre.0 Request processed in 129us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791115.544393:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787791115.545020:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791115.545065:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791115.545112:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.545141:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.545220:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268187904 00000100:00100000:0.0:1787791115.545226:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268187904 00000100:00100000:0.0:1787791115.545266:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787791115.545273:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268187904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791115.545353:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268187904:12345-0@lo:503:mount.lustre.0 Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.545361:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787791115.545405:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268187904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787791115.546593:0:24201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787791115.548912:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.548993:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.549041:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5540 going to sleep for 11 seconds 00000100:00100000:1.0:1787791115.549366:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188032 00000100:00100000:1.0:1787791115.549373:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188032 00000100:00100000:1.0:1787791115.549427:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787791115.549443:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.549571:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188032:12345-0@lo:502:mount.lustre.0 Request processed in 130us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791115.549579:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787791115.549672:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188032:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791115.549934:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1787791115.549965:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1787791115.549980:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1787791115.549994:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1787791115.550008:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1787791115.550021:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1787791115.550035:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1787791115.550049:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1787791115.550062:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1787791115.550086:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1787791115.550100:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1787791115.550113:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1787791115.550126:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1787791115.550139:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1787791115.550150:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1787791115.550317:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1787791115.550335:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1787791115.550356:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1787791115.550369:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1787791115.550384:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1787791115.550398:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1787791115.550410:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1787791115.550422:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1787791115.550436:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1787791115.550449:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1787791115.550476:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1787791115.550490:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1787791115.550504:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1787791115.550516:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1787791115.550528:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1787791115.550541:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1787791115.550553:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1787791115.550565:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1787791115.550576:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1787791115.550588:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1787791115.550596:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1787791115.550603:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1787791115.550610:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1787791115.550617:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1787791115.550624:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1787791115.550630:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1787791115.550648:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1787791115.550656:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1787791115.550663:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1787791115.550670:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1787791115.550677:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1787791115.550684:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1787791115.550691:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1787791115.550755:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.550804:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.550837:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188160 00000100:00100000:0.0:1787791115.550843:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188160 00000100:00100000:0.0:1787791115.550874:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787791115.551915:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.552042:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188160:12345-0@lo:502:mount.lustre.0 Request processed in 138us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.552050:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787791115.552110:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.552130:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791115.552437:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1787791115.552464:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1787791115.552495:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791115.552536:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.552565:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5540 going to sleep for 11 seconds 00000100:00100000:1.0:1787791115.552690:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188288 00000100:00100000:1.0:1787791115.552696:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188288 00000100:00100000:1.0:1787791115.552762:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787791115.552770:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791115.552845:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268188288:12345-0@lo:502:mount.lustre.0 Request processed in 75us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791115.552852:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787791115.553084:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268188288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791115.553124:0:24201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1787791115.553133:0:24201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787791115.554106:0:24227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787791115.554122:0:24227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff916fc34ab370) 00000020:00000080:0.0:1787791115.554144:0:24227:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1787791115.554345:0:24227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170c7da0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787791115.554349:0:24227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170c7da0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787791115.554353:0:24227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170c7da0000 3 00010000:00080000:0.0:1787791115.554381:0:24227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9170c710b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787791115.562515:0:24227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1787791115.562790:0:24227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787791115.562837:0:24227:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787791115.562850:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf9477fddcf1f612 00000100:00080000:2.0:1787791115.562861:0:24227:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787791115.562866:0:24227:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9170c710b800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787791115.562906:0:24227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3764f00 x1874634268188416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787791115.562936:0:24227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787791115.562977:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268188416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791115.563047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787791115.563048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.563059:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.563062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.563064:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.563086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.563089:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.563091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.563094:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787791115.563107:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188416 00000100:00100000:3.0:1787791115.563114:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188416 00000100:00100000:0.0:1787791115.563119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268188544:0@lo:400:kworker.0 00000100:00100000:3.0:1787791115.563143:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787791115.563150:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791115.563151:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268188416:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787791115.563184:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787791115.563190:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268188672:0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.563246:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268188800:0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.563288:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791115.563292:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268188928:0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563312:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.563332:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188544 00000100:00100000:0.0:1787791115.563336:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188544 00000100:00100000:0.0:1787791115.563360:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188800 00000100:00100000:0.0:1787791115.563362:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188800 00000100:00100000:0.0:1787791115.563375:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791115.563381:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268188544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563431:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268188544:12345-0@lo:400:kworker.0 Request processed in 49us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.563444:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791115.563460:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787791115.563466:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268188800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563500:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268188800:12345-0@lo:400:kworker.0 Request processed in 35us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.563506:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787791115.563523:0:22702:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787791115.563530:0:22702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787791115.563563:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268188544:0@lo:400:kworker.0 00000100:00100000:0.0:1787791115.563584:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268188800:0@lo:400:kworker.0 00010000:00080000:3.0:1787791115.563753:0:22701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:3.0:1787791115.563788:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf9477fddcf1f619 00000004:00100000:3.0:1787791115.563814:0:22701:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787791115.563846:0:22701:0:(import.c:65:import_set_state_nolock()) ffff9170c3530800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791115.563892:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874634268188416:12345-0@lo:38:llog_process_th.0 Request processed in 740us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.563900:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791115.563912:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188672 00000100:00100000:3.0:1787791115.563915:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188672 00000100:00100000:3.0:1787791115.563931:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268188928 00000100:00100000:3.0:1787791115.563933:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268188928 00000100:00100000:3.0:1787791115.563944:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787791115.563949:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268188672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791115.563992:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268188672:12345-0@lo:400:kworker.0 Request processed in 42us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.563998:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787791115.564009:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787791115.564015:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268188928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791115.564044:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268188928:12345-0@lo:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791115.564050:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1787791115.564087:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170ff5d43c0 x1874634268188672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791115.564098:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268188672:0@lo:400:kworker.0 00010000:00080000:3.0:1787791115.564119:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170ff5d4000 x1874634268188928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791115.564128:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268188928:0@lo:400:kworker.0 00010000:00080000:3.0:1787791115.564148:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff916fc3764f00 x1874634268188416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791115.564166:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791115.564172:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787791115.564178:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787791115.564298:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787791115.564302:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c710b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791115.564308:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1874634268188416:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1787791115.567085:0:24227:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787791115.567101:0:24227:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff916fc34a8000) 00000020:00000080:0.0:1787791115.567126:0:24227:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787791115.567334:0:24227:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170c7da0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787791115.567339:0:24227:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170c7da0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787791115.567342:0:24227:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170c7da0000 3 00010000:00080000:0.0:1787791115.567372:0:24227:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc44c4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787791115.571998:0:24227:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787791115.572213:0:24227:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787791115.572262:0:24227:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787791115.572276:0:24227:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf9477fddcf1f627 00000100:00080000:0.0:1787791115.572287:0:24227:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787791115.572294:0:24227:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff916fc44c4000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787791115.572331:0:24227:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170ff5d6d00 x1874634268189056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787791115.572368:0:24227:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787791115.572404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.572409:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.572411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.572414:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.572417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.572420:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787791115.572422:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787791115.572425:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787791115.572665:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268189056:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791115.572761:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.574811:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189056 00000100:00100000:0.0:1787791115.574825:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189056 00000100:00100000:0.0:1787791115.574946:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787791115.574955:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1874634268189056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787791115.574989:0:22701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 664 last 0 00000020:00000080:0.0:1787791115.575026:0:22701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf9477fddcf1f62e 00000004:00100000:0.0:1787791115.575044:0:22701:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787791115.575076:0:22701:0:(import.c:65:import_set_state_nolock()) ffff916fc44c4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791115.575173:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874634268189056:12345-0@lo:38:llog_process_th.0 Request processed in 217us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.575180:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787791115.575209:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9170ff5d6d00 x1874634268189056/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791125 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791115.575221:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791115.575229:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787791115.575237:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787791115.575241:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787791115.575243:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc44c4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791115.575249:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1874634268189056:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787791115.575301:0:24227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1787791115.576004:0:24201:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787791115.576037:0:24201:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787791115.576052:0:24201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f604 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.576063:0:24201:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e200/0xcf9477fddcf1f5fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f604 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787791115.576111:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787791115.576113:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787791115.576115:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791115.576116:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791115.576117:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791115.576119:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791115.576120:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787791115.576122:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791115.576123:0:24201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787791115.576127:0:24201:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787791115.576130:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787791115.576136:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787791115.576137:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791115.576138:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791115.576139:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791115.576140:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791115.576140:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787791115.576141:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791115.576142:0:24201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787791115.576164:0:24201:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787791115.576183:0:24201:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268189184:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787791115.576235:0:24201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791115.576275:0:24201:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170ed915540 going to sleep for 11 seconds 00000100:00100000:1.0:1787791115.576980:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189184 00000100:00100000:1.0:1787791115.576988:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189184 00000100:00100000:1.0:1787791115.577034:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787791115.577043:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:24201:x1874634268189184:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787791115.577083:0:22694:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787791115.577097:0:22694:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787791115.583916:0:22694:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787791115.583934:0:22694:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787791115.584026:0:22716:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787791115.584031:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787791115.584053:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584082:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584089:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 21 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584096:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584133:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 21 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584146:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 21 pid: 22695 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.584168:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268189312:0@lo:104: 00000100:00100000:0.0:1787791115.584234:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791115.584292:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584301:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.584309:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268189440:0@lo:104: 00000100:00100000:0.0:1787791115.584334:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.584352:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787791115.584378:0:22684:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787791115.584395:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189312 00000100:00100000:0.0:1787791115.584402:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189312 00000100:00100000:0.0:1787791115.584443:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189440 00000100:00100000:0.0:1787791115.584447:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189440 00000100:00100000:0.0:1787791115.584461:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791115.584467:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268189312:12345-0@lo:104: 00010000:00010000:0.0:1787791115.584480:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584529:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787791115.584535:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268189312:12345-0@lo:104: Request processed in 68us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.584542:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791115.584558:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787791115.584565:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc51a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268189440:12345-0@lo:104: 00010000:00010000:0.0:1787791115.584572:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584605:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787791115.584611:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc51a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268189440:12345-0@lo:104: Request processed in 47us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791115.584617:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787791115.584656:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791115.584662:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584670:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791115.584674:0:22689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584682:0:22689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791115.584696:0:22689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791115.584728:0:22689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791115.584770:0:22689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584777:0:22689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791115.584804:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584812:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f58d expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584822:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791115.584825:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584830:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2e00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791115.584833:0:22689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584839:0:22689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791115.584845:0:22689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791115.584851:0:22689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791115.584872:0:22689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584878:0:22689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791115.584885:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.584891:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2e00/0xcf9477fddcf1f578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f57f expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791115.584901:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268189568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791115.584903:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791115.584904:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791115.584906:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791115.584911:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791115.584928:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268189696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791115.584935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791115.584973:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268189312:0@lo:104: 00000100:00100000:0.0:1787791115.584982:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268189440:0@lo:104: 00010000:00010000:0.0:1787791115.584998:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.585173:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791115.585252:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189568 00000100:00100000:3.0:1787791115.585257:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189568 00010000:00010000:3.0:1787791115.585278:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 22 pid: 22695 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791115.596103:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189696 00000100:00100000:1.0:1787791115.596118:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189696 00010000:00010000:1.0:1787791115.596168:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 23 pid: 22694 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791115.596204:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787791115.596214:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:3640:x1874634268189568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791115.596230:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791115.596236:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 23 pid: 22695 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596248:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 23 pid: 22695 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596276:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26faa00/0xcf9477fddcf1f58d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f586 expref: 23 pid: 22695 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596293:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791115.596366:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:3640:x1874634268189568:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (11430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791115.596374:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787791115.596393:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787791115.596399:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3641:x1874634268189696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791115.596407:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791115.596411:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596420:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596430:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d5a00/0xcf9477fddcf1f57f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f578 expref: 21 pid: 22694 timeout: 764 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596442:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596450:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787791115.596466:0:22686:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012436198s 00010000:00010000:1.0:1787791115.596471:0:22686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596488:0:22686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596494:0:22686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596501:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596508:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791115.596513:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596521:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596534:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791115.596544:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791115.596570:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:3641:x1874634268189696:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (11397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791115.596577:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787791115.597312:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:24201:x1874634268189184:12345-0@lo:253:mount.lustre.0 Request processed in 20266us (21072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791115.597324:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787791115.597424:0:24201:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:24201:1874634268189184:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787791115.597437:0:24201:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787791115.597440:0:24201:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787791115.597442:0:24201:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787791115.597443:0:24201:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787791115.597444:0:24201:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787791115.597446:0:24201:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787791115.597453:0:24201:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787791115.597455:0:24201:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787791115.597456:0:24201:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787791115.597458:0:24201:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787791115.597473:0:24201:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1787791115.597523:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268189568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791115.599670:0:22716:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.599690:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791115.599698:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f635 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791115.599806:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268189696:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1787791115.603152:0:24201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1787791115.615799:0:24201:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787791115.615810:0:24201:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787791115.615842:0:24201:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787791115.615889:0:24201:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787791115.615906:0:24201:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787791115.615925:0:24201:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1787791115.620407:0:24201:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787791115.620635:0:24201:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787791116.180755:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787791116.500558:0:24282:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787791116.501081:0:24282:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1787791116.940768:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787791116.940775:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce838000 from 13 10000000:01000000:2.0:1787791116.940780:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791116.940827:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.940838:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.940848:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791116.940944:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268189824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791116.941006:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791116.941043:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791116.941087:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189824 00000100:00100000:3.0:1787791116.941093:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189824 00000100:00100000:3.0:1787791116.941137:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787791116.941143:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+19:22697:x1874634268189824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791116.941153:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791116.941162:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f63c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.941179:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.941186:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 20 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.941192:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fa800, rc 0) 00000100:00100000:3.0:1787791116.941225:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:22697:x1874634268189824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791116.941232:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787791116.941315:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268189824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791116.941331:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.941340:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791116.941464:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268189952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787791116.941497:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791116.941513:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791116.941551:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268189952 00000100:00100000:3.0:1787791116.941555:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268189952 00000100:00100000:3.0:1787791116.941608:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787791116.941616:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:22697:x1874634268189952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787791116.941630:0:22694:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787791116.941648:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787791116.941651:0:22694:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787791116.941756:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:22697:x1874634268189952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 137us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791116.941769:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787791116.941837:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268189952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787791116.941964:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787791116.941970:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.941978:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791116.941986:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787791116.941988:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f39e2000 from 13 10000000:01000000:2.0:1787791116.941991:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791116.942007:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.942013:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791116.942020:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791116.942031:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268190080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791116.942055:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791116.942314:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc2726600 going to sleep for 11 seconds 00000100:00100000:3.0:1787791116.942568:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190080 00000100:00100000:3.0:1787791116.942572:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190080 00000100:00100000:3.0:1787791116.942611:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787791116.942619:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:22697:x1874634268190080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791116.942628:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791116.942638:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f64a expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.942656:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.942665:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 21 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791116.942672:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:3.0:1787791116.942730:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268190080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791116.942736:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787791116.944915:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268190080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787791116.944943:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791116.944955:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791116.945027:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268190208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787791116.945084:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791116.945127:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2ba8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791116.945443:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190208 00000100:00100000:3.0:1787791116.945448:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190208 00000100:00100000:3.0:1787791116.945485:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787791116.945491:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268190208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787791116.945507:0:22694:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787791116.945521:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787791116.945523:0:22694:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787791116.945614:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268190208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791116.945631:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787791116.945873:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268190208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787791116.945990:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787791116.945999:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791116.946009:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791117.195940:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791117.644559:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268190336:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791117.644635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791117.644695:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190336 00000100:00100000:1.0:1787791117.644702:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190336 00000100:00100000:1.0:1787791117.644788:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787791117.644798:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268190336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787791117.644833:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787791117.644892:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268190336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791117.644900:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787791117.644972:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268190336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791117.645612:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787791117.645622:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268190464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787791117.645656:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791117.645699:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190464 00000100:00100000:2.0:1787791117.645734:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190464 00000100:00100000:2.0:1787791117.645764:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787791117.645770:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268190464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787791117.645789:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787791117.645825:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268190464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791117.645832:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787791117.645874:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268190464:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787791118.233505:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791119.243138:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787791119.695535:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787791120.268053:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787791120.720133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791120.720140:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787791120.720143:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791120.720147:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787791120.720190:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791120.720193:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787791120.720197:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791120.720200:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787791120.720250:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268190592:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720389:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268191104:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720422:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720447:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787791120.720454:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268190720:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720477:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720493:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268191232:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268190848:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720589:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268191360:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720611:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720625:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791120.720630:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268190976:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791120.720700:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190592 00000100:00100000:1.0:1787791120.720735:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190592 00000100:00100000:1.0:1787791120.720787:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787791120.720796:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268190592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.720876:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268190592:12345-0@lo:400:kworker.0 Request processed in 80us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.720883:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787791120.720918:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191104 00000100:00100000:1.0:1787791120.720922:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191104 00000100:00100000:1.0:1787791120.720943:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191232 00000100:00100000:1.0:1787791120.720947:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191232 00000100:00100000:1.0:1787791120.720971:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190848 00000100:00100000:1.0:1787791120.720974:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190848 00000100:00100000:1.0:1787791120.720986:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191360 00000100:00100000:1.0:1787791120.720989:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191360 00000100:00100000:1.0:1787791120.721006:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791120.721012:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268191104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721045:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268191104:12345-0@lo:400:kworker.0 Request processed in 33us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721052:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791120.721063:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791120.721069:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268191232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721093:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268191232:12345-0@lo:400:kworker.0 Request processed in 25us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721099:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791120.721109:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791120.721114:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268190848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721144:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268190848:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721150:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791120.721160:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787791120.721173:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268191360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721201:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268191360:12345-0@lo:400:kworker.0 Request processed in 29us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721206:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787791120.721225:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190720 00000100:00100000:1.0:1787791120.721229:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190720 00000100:00100000:1.0:1787791120.721245:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268190976 00000100:00100000:1.0:1787791120.721247:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268190976 00000100:00100000:1.0:1787791120.721258:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791120.721264:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268190720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721296:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268190720:12345-0@lo:400:kworker.0 Request processed in 32us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721302:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791120.721314:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787791120.721320:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268190976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721347:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268190976:12345-0@lo:400:kworker.0 Request processed in 27us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791120.721353:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787791120.721408:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787791120.721412:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787791120.721442:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268190976:0@lo:400:kworker.0 00010000:00080000:1.0:1787791120.721456:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3b91a40 x1874634268190848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791120.721467:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268190848:0@lo:400:kworker.0 00010000:00080000:1.0:1787791120.721477:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3b930c0 x1874634268191360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791120.721498:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268191360:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721536:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268190720:0@lo:400:kworker.0 00010000:00080000:1.0:1787791120.721547:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3b90f00 x1874634268191232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791120.721555:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268191232:0@lo:400:kworker.0 00000100:00100000:1.0:1787791120.721563:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268190592:0@lo:400:kworker.0 00010000:00080000:1.0:1787791120.721572:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3b93840 x1874634268191104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791120.721580:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268191104:0@lo:400:kworker.0 00010000:00010000:2.0:1787791121.295695:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787791121.961409:0:24572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787791122.314899:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791122.767096:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268191616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791122.767177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791122.771294:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191616 00000100:00100000:3.0:1787791122.771404:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191616 00000100:00100000:3.0:1787791122.771472:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787791122.771484:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268191616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787791122.771525:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787791122.771605:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268191616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791122.771613:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787791122.771691:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268191488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791122.771756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791122.771812:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191488 00000100:00100000:1.0:1787791122.771933:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191488 00000100:00100000:1.0:1787791122.771956:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791122.771962:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268191488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787791122.771980:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787791122.772012:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268191488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791122.772018:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791122.772188:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268191488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787791122.772293:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268191616:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1787791122.775242:0:24625:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787791122.775593:0:24625:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787791123.340093:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787791123.569244:0:24675:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787791123.570042:0:24675:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787791124.368364:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787791124.562108:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787791125.388367:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787791125.840177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791125.840184:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791125.840187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791125.840190:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791125.840205:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791125.840208:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787791125.840211:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787791125.840214:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791125.840262:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268192128:0@lo:400:kworker.0 00000100:00100000:2.0:1787791125.840338:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791125.840401:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787791125.840408:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268191744:0@lo:400:kworker.0 00000100:00100000:2.0:1787791125.840437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791125.840439:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192128 00000100:00100000:3.0:1787791125.840447:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192128 00000100:00100000:2.0:1787791125.840458:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268192256:0@lo:400:kworker.0 00000100:00100000:2.0:1787791125.840479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791125.840491:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787791125.840499:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268192128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791125.840559:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268192128:12345-0@lo:400:kworker.0 Request processed in 61us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791125.840566:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787791125.840585:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268192128:0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.840680:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268191872:0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.840736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791125.840751:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268192384:0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.840771:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791125.840873:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191872 00000100:00100000:3.0:1787791125.840877:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191872 00000100:00100000:3.0:1787791125.840900:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787791125.840906:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268191872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.840948:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787791125.840955:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268192000:0@lo:400:kworker.0 00000100:00100000:2.0:1787791125.841050:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192256 00000100:00100000:2.0:1787791125.841055:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192256 00000100:00100000:2.0:1787791125.841085:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192384 00000100:00100000:2.0:1787791125.841088:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192384 00000100:00100000:2.0:1787791125.841115:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787791125.841122:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268192256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791125.842526:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787791125.842548:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268192384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791125.843068:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268191872:12345-0@lo:400:kworker.0 Request processed in 2158us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791125.843078:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787791125.843676:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791125.844326:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268192512:0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.844512:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791125.844551:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268191872:0@lo:400:kworker.0 00000100:00080000:1.0:1787791125.844588:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787791125.844604:0:24230:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787791125.844611:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787791125.844769:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268191744 00000100:00100000:1.0:1787791125.844776:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268191744 00000100:00100000:1.0:1787791125.845321:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787791125.845330:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.845524:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268191744:12345-0@lo:400:kworker.0 Request processed in 194us (5085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791125.845532:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787791125.845565:0:22702:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787791125.845571:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192000 00000100:00100000:1.0:1787791125.845575:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192000 00000100:00100000:1.0:1787791125.845593:0:22702:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787791125.845597:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192512 00000100:00100000:1.0:1787791125.845599:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192512 00000100:00100000:1.0:1787791125.845619:0:22702:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787791125.845632:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787791125.845639:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268192000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.845689:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268192000:12345-0@lo:400:kworker.0 Request processed in 51us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791125.845696:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787791125.845728:0:22702:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787791125.845735:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787791125.845740:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268192512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791125.845768:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268192512:12345-0@lo:400:kworker.0 Request processed in 28us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791125.845773:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787791125.846306:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787791125.846411:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268191744:0@lo:400:kworker.0 00010000:00080000:1.0:1787791125.846526:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3764f00 x1874634268192000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791125.846539:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268192000:0@lo:400:kworker.0 00010000:00080000:1.0:1787791125.846551:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc37661c0 x1874634268192512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791125.846560:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268192512:0@lo:400:kworker.0 00000100:00100000:2.0:1787791125.847452:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268192256:12345-0@lo:400:kworker.0 Request processed in 6323us (6964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791125.847464:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787791125.848380:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268192384:12345-0@lo:400:kworker.0 Request processed in 5834us (7603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791125.848390:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787791125.848520:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3765a40 x1874634268192384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791125.848535:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268192384:0@lo:400:kworker.0 00010000:00080000:1.0:1787791125.849409:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff916fc3767840 x1874634268192256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791125.849422:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268192256:0@lo:400:kworker.0 00010000:00010000:1.0:1787791126.411120:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791126.862377:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791111/real 1787791111] req@ffff9170e47f4b40 x1874634268183808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.862410:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170e47f4b40 x1874634268183808/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.862419:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791111/real 1787791111] req@ffff9170c9968b40 x1874634268183936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791126 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.862429:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9170c9968b40 x1874634268183936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791126 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787791126.862450:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791126.862523:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791126.862529:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268183808:0@lo:8:kworker.0 00000100:00080000:0.0:1787791126.862537:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791126.864123:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.864130:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791126.864133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.864136:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791126.864163:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.864166:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787791126.864169:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791126.864175:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787791126.864180:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787791126.864187:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9170f3c46000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791126.864211:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4d58780 x1874634268193152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787791126.864222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.864225:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787791126.864226:0:8:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791126.864229:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1787791126.864231:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787791126.864234:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170c7da2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791126.864243:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4d5b0c0 x1874634268193280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787791126.864367:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268192640:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864498:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268193408:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864537:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787791126.864541:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268192768:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864567:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268193536:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864579:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864598:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268193024:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864612:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864622:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787791126.864625:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268192896:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864654:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864672:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268193664:0@lo:400:kworker.0 00000100:00100000:1.0:1787791126.864693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791126.864740:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193408 00000100:00100000:1.0:1787791126.864747:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193408 00000100:00100000:3.0:1787791126.865722:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192640 00000100:00100000:3.0:1787791126.865729:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192640 00000100:00100000:3.0:1787791126.865770:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787791126.865779:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268192640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791126.865861:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3640:x1874634268192640:12345-0@lo:400:kworker.0 Request processed in 82us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791126.865868:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787791126.865910:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193536 00000100:00100000:1.0:1787791126.865916:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193536 00000100:00100000:3.0:1787791126.865930:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268192640:0@lo:400:kworker.0 00000100:00080000:0.0:1787791126.866034:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791126.866041:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268183936:0@lo:8:kworker.0 00000100:00100000:1.0:1787791126.866051:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192896 00000100:00100000:1.0:1787791126.866056:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192896 00000100:00100000:0.0:1787791126.866094:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193664 00000100:00100000:0.0:1787791126.866099:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193664 00000100:00100000:0.0:1787791126.866129:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787791126.866136:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268193408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.866181:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268193408:12345-0@lo:400:kworker.0 Request processed in 46us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791126.866188:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787791126.866204:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787791126.866209:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268193536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.866236:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268193536:12345-0@lo:400:kworker.0 Request processed in 27us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791126.866241:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787791126.866253:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787791126.866259:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268192896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.866297:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4462940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268192896:12345-0@lo:400:kworker.0 Request processed in 38us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791126.866304:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787791126.866319:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787791126.866326:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268193664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.866358:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874634268193664:12345-0@lo:400:kworker.0 Request processed in 33us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791126.866364:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787791126.866419:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.866424:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791126.866426:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791126.866429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787791126.869108:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268192768 00000100:00100000:2.0:1787791126.869118:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268192768 00010000:00080000:0.0:1787791126.869132:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d59e00 x1874634268192896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.869150:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268192896:0@lo:400:kworker.0 00000100:00100000:2.0:1787791126.869158:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193024 00000100:00100000:2.0:1787791126.869163:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193024 00010000:00080000:0.0:1787791126.869175:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5b480 x1874634268193664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791126.869183:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787791126.869196:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268192768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.869209:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1874634268193664:0@lo:400:kworker.0 00010000:00080000:0.0:1787791126.869259:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d59680 x1874634268193536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.869270:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268193536:0@lo:400:kworker.0 00000100:00100000:2.0:1787791126.869287:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268192768:12345-0@lo:400:kworker.0 Request processed in 93us (4727us total) trans 0 rc 0/0 00010000:00080000:0.0:1787791126.869289:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5bc00 x1874634268193408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791126.869305:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787791126.869307:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268193408:0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.869331:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268192768:0@lo:400:kworker.0 00000100:00100000:2.0:1787791126.869337:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787791126.869346:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268193024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791126.869378:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268193152:0@lo:8:kworker.0 00000100:00100000:2.0:1787791126.869389:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4463c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268193024:12345-0@lo:400:kworker.0 Request processed in 43us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791126.869396:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787791126.869426:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791126.869468:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268193280:0@lo:8:kworker.0 00000100:00100000:0.0:1787791126.869495:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791126.869668:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193152 00000100:00100000:2.0:1787791126.869673:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193152 00000100:00100000:2.0:1787791126.869691:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193280 00000100:00100000:2.0:1787791126.869695:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193280 00000100:00100000:2.0:1787791126.869730:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791126.869736:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874634268193152:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787791126.869763:0:24206:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 675 last 0 00000020:00000080:2.0:1787791126.869805:0:24206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f658 00002000:00100000:2.0:1787791126.869821:0:24206:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9170c769d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1787791126.869825:0:24206:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1787791126.869828:0:24206:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787791126.870061:0:24206:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1787791126.870100:0:24206:0:(import.c:65:import_set_state_nolock()) ffff9170c7699000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787791126.870144:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268193152:12345-0@lo:8:kworker.0 Request processed in 407us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791126.870152:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787791126.870167:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787791126.870171:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874634268193280:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787791126.870184:0:24206:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787791126.871841:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d58780 x1874634268193152/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791146 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791126.871856:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791126.871864:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787791126.871873:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787791126.871879:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787791126.871882:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c46000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787791126.871904:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787791126.871910:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268193152:0@lo:8:kworker.0 00000004:00080000:0.0:1787791126.871975:0:23442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787791126.872081:0:23442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 675820375467ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787791126.872105:0:23442:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1787791126.872148:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268193024:0@lo:400:kworker.0 00000004:00080000:0.0:1787791126.872231:0:23443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787791126.872258:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268193920:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787791126.872334:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791126.872352:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170e15cb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791126.872365:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791126.872373:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268193792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791126.872422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791126.872461:0:24208:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787791126.872467:0:24208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787791126.873227:0:24207:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787791126.873242:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193920 00000100:00100000:1.0:1787791126.873248:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193920 00000100:00080000:1.0:1787791126.873594:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791126.873854:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268193792 00000100:00100000:3.0:1787791126.873859:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268193792 00000100:00100000:3.0:1787791126.873898:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787791126.873908:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1874634268193792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787791126.873936:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787791126.874002:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1874634268193792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791126.874009:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787791126.874052:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5d70c0 x1874634268193792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787791142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791126.874072:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268193792:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787791126.874892:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787791126.874903:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23443:x1874634268193920:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787791126.875056:0:23434:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1787791126.882147:0:24827:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1787791126.882156:0:24827:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1787791126.882255:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23443:x1874634268193920:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7351us (9930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791126.882265:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787791126.885802:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170ff5d5e00 x1874634268193920/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787791142 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791126.885827:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d5e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268193920:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787791126.885847:0:23443:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787791126.885926:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268194048:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787791126.886018:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791126.886057:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e900 going to sleep for 11 seconds 00000100:00100000:1.0:1787791126.886740:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194048 00000100:00100000:1.0:1787791126.886749:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194048 00000100:00100000:1.0:1787791126.886815:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787791126.886827:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23443:x1874634268194048:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1787791126.886857:0:24207:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787791126.886934:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23443:x1874634268194048:12345-0@lo:5:osp-pre-0-1.0 Request processed in 109us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791126.886941:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787791126.886982:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5ad00 x1874634268194048/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787791142 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791126.886995:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268194048:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787791126.887008:0:23443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787791126.887045:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268194176:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787791126.887074:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791126.887103:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787791126.887144:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194176 00000100:00100000:0.0:1787791126.887150:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194176 00000100:00100000:0.0:1787791126.887187:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787791126.887195:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23443:x1874634268194176:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787791126.887226:0:24827:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1787791126.904334:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1874634268193280:12345-0@lo:8:kworker.0 Request processed in 34150us (34828us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787791126.904358:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787791126.904768:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787791126.904776:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787791126.904792:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268193280:0@lo:8:kworker.0 00000001:00080000:3.0:1787791126.959985:0:24202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1787791126.960003:0:24202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787791126.963055:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d58780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23443:x1874634268194176:12345-0@lo:5:osp-pre-0-1.0 Request processed in 75848us (75967us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787791126.963071:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787791126.963176:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5ad00 x1874634268194176/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787791142 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791126.963190:0:23443:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1787791126.963199:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23443:1874634268194176:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787791126.963216:0:23443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1787791126.963275:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23443:1874634268194304:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787791126.963317:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791126.963431:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787791126.963670:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194304 00000100:00100000:0.0:1787791126.963677:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194304 00000100:00100000:0.0:1787791126.963758:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787791126.963769:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23443:x1874634268194304:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787791126.963822:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23443:x1874634268194304:12345-0@lo:900:osp-pre-0-1.0 Request processed in 56us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791126.963829:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787791126.964017:0:23443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5ad00 x1874634268194304/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787791142 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791126.964027:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23443:1874634268194304:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787791127.435027:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791127.883067:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268194432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787791127.883130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791127.883423:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194432 00000100:00100000:2.0:1787791127.883432:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194432 00000100:00100000:2.0:1787791127.883488:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787791127.883497:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268194432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787791127.883532:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787791127.883585:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268194432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791127.883590:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787791127.884021:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268194560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791127.884057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791127.884114:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268194432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791127.884164:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194560 00000100:00100000:2.0:1787791127.884168:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194560 00000100:00100000:2.0:1787791127.884232:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787791127.884249:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268194560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787791127.884268:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787791127.884313:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4461e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268194560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791127.884320:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787791127.884439:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3767840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268194560:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787791128.458994:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791129.483829:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787791129.935215:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787791130.507999:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787791130.970213:0:25022:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787791130.970218:0:25022:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787791130.970219:0:25022:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787791130.970345:0:25022:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9170f4f9c800 00000020:01000004:1.0:1787791130.970362:0:25022:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787791130.970378:0:25022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787791130.970394:0:25022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff916fc3208000) 00000020:00000080:1.0:1787791130.970429:0:25022:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787791131.034476:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787791131.035567:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787791131.036472:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1787791131.036869:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787791131.037142:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787791131.037376:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787791131.037565:0:25022:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:2.0:1787791131.047984:0:25022:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787791131.048263:0:25022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787791131.048278:0:25022:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787791131.048292:0:25022:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1f666 00000020:01000004:2.0:1787791131.048300:0:25022:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1787791131.048323:0:25022:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787791131.048327:0:25022:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787791131.048333:0:25022:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787791131.048362:0:25022:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1787791131.048367:0:25022:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787791131.088992:0:25022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787791131.089046:0:25022:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787791131.089050:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787791131.089052:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787791131.089054:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791131.089055:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791131.089056:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791131.089057:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791131.089059:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791131.089060:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791131.089062:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791131.089065:0:25022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787791131.089068:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787791131.089069:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787791131.089070:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791131.089071:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791131.089073:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791131.089074:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791131.089075:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791131.089086:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791131.089087:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787791131.089116:0:25022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787791131.089138:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787791131.089212:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.089269:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787791131.089407:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194688 00000100:00100000:1.0:1787791131.089414:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194688 00000100:00100000:1.0:1787791131.089464:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787791131.089475:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:25022:x1874634268194688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787791131.089527:0:22695:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787791131.089531:0:22695:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787791131.089536:0:22695:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787791131.090372:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:25022:x1874634268194688:12345-0@lo:253:mount.lustre.0 Request processed in 895us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.090382:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787791131.090619:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787791131.090630:0:25022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787791131.090633:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787791131.090634:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787791131.090636:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791131.090637:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791131.090638:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791131.090639:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791131.090640:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791131.090655:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791131.090656:0:25022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787791131.090682:0:25022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9170f4f9c800 from lustre-OST0001 10000000:01000000:0.0:1787791131.090759:0:25022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787791131.090766:0:25022:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787791131.090778:0:25022:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff916fc45f99b8 local copy 00010000:00010000:0.0:1787791131.090790:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.090901:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791131.090934:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.091018:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.091548:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194816 00000100:00100000:2.0:1787791131.091555:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194816 00000100:00100000:2.0:1787791131.091670:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787791131.091680:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:25022:x1874634268194816:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791131.099327:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:25022:x1874634268194816:12345-0@lo:501:mount.lustre.0 Request processed in 7636us (8379us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787791131.099344:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787791131.099482:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194816:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787791131.099507:0:25022:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787791131.099538:0:25022:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787791131.099549:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.099560:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d4000/0xcf9477fddcf1f380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f387 expref: -99 pid: 22679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791131.099623:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9170f4f9c800 10000000:01000000:0.0:1787791131.099629:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787791131.099637:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787791131.099639:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787791131.099644:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787791131.099647:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787791131.099689:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.099745:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.099756:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.099775:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194944:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787791131.099814:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.099847:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.100024:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268194944 00000100:00100000:2.0:1787791131.100030:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268194944 00000100:00100000:2.0:1787791131.100145:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787791131.100154:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:25022:x1874634268194944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791131.100168:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791131.100181:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f674 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f66d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.100203:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f66d expref: 22 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.100214:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2e00/0xcf9477fddcf1f674 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f66d expref: 22 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.100231:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2e00, rc 0) 00000100:00100000:2.0:1787791131.100371:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268194944:12345-0@lo:101:mount.lustre.0 Request processed in 217us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.100378:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787791131.101412:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268194944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787791131.101435:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f674 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.101445:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f674 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787791131.102765:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1787791131.103447:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787791131.106861:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1787791131.106943:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1787791131.106963:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1787791131.106981:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1787791131.107009:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1787791131.107029:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1787791131.107045:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1787791131.107070:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1787791131.107087:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1787791131.107115:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1787791131.107130:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1787791131.107553:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791131.107746:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.107795:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.108149:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195072 00000100:00100000:2.0:1787791131.108160:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195072 00000100:00100000:2.0:1787791131.108208:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787791131.108216:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791131.108380:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195072:12345-0@lo:501:mount.lustre.0 Request processed in 163us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.108387:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787791131.108606:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791131.108651:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791131.108756:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.108890:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.109443:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195200 00000100:00100000:2.0:1787791131.109450:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195200 00000100:00100000:2.0:1787791131.109540:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787791131.109550:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195200:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791131.114554:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195200:12345-0@lo:503:mount.lustre.0 Request processed in 4995us (5787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.114580:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787791131.115377:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787791131.120446:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787791131.120579:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791131.120693:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791131.121185:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2ba8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.127670:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195328 00000100:00100000:3.0:1787791131.127687:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195328 00000100:00100000:3.0:1787791131.127847:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787791131.127858:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.128529:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195328:12345-0@lo:502:mount.lustre.0 Request processed in 670us (7834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.128540:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787791131.128564:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195328:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787791131.128894:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787791131.128938:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787791131.128952:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787791131.128966:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1787791131.130687:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1787791131.130815:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1787791131.130837:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1787791131.130852:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1787791131.130860:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1787791131.130907:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791131.131007:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.131196:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.131546:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195456 00000100:00100000:3.0:1787791131.131552:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195456 00000100:00100000:3.0:1787791131.131609:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787791131.131618:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195456:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791131.131951:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195456:12345-0@lo:502:mount.lustre.0 Request processed in 333us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.131959:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787791131.132083:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791131.132141:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:0.0:1787791131.132151:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787791131.132910:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787791131.132920:0:25026:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787791131.132927:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.132929:0:25026:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787791131.132936:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787791131.132960:0:25026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9170fbee8000) 00000020:00000080:0.0:1787791131.133129:0:25026:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787791131.133137:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787791131.133193:0:25026:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f4f9c800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787791131.133199:0:25026:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787791131.133205:0:25026:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf9477fddcf1f682 00010000:00010000:0.0:1787791131.141557:0:25026:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1787791131.142247:0:25026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1787791131.144296:0:25026:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787791131.155488:0:25026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787791131.155502:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791131.155509:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.155512:0:25026:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787791131.155516:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791131.155520:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.155522:0:25026:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787791131.155524:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787791131.155527:0:25026:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787791131.155529:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791131.155531:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.155532:0:25026:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787791131.155534:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787791131.155536:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.155538:0:25026:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787791131.155541:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787791131.155578:0:25026:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787791131.155581:0:25026:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787791131.155582:0:25026:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787791131.155586:0:25026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787791131.168272:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787791131.168323:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787791131.168350:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f674 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791131.168364:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9fa00/0xcf9477fddcf1f66d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f674 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791131.168375:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f4f9c800 from 1 10000000:01000000:3.0:1787791131.168378:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787791131.168423:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791131.168431:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791131.168459:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791131.168486:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195584:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787791131.168558:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.168609:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f77543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791131.168739:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195584 00000100:00100000:1.0:1787791131.168747:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195584 00000100:00100000:1.0:1787791131.168794:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787791131.168804:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:25022:x1874634268195584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787791131.168817:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791131.168831:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f689 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.168865:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.168877:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.168886:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d4c00, rc 0) 00000100:00100000:1.0:1787791131.168930:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195584:12345-0@lo:101:mount.lustre.0 Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.168937:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787791131.169844:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787791131.169864:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791131.169875:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787791131.175204:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787791131.175512:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787791131.176324:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787791131.176354:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787791131.176371:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787791131.176387:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787791131.176400:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787791131.176413:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787791131.176425:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787791131.176438:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787791131.176452:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787791131.176465:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787791131.176477:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787791131.176498:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787791131.176502:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787791131.176908:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195712:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791131.177051:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.177201:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f7754780 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.185515:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195712 00000100:00100000:2.0:1787791131.185529:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195712 00000100:00100000:3.0:1787791131.186146:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787791131.186160:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787791131.186349:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195712:12345-0@lo:501:mount.lustre.0 Request processed in 191us (9298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.186358:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787791131.186433:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195712:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787791131.186488:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195840:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787791131.186545:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.197233:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787791131.200872:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195840 00000100:00100000:1.0:1787791131.200888:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195840 00000100:00100000:1.0:1787791131.200964:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787791131.200975:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787791131.201292:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195840:12345-0@lo:503:mount.lustre.0 Request processed in 318us (14745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.201301:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787791131.201336:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195840:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787791131.201879:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787791131.201967:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195968:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791131.202021:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.202049:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787791131.202296:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268195968 00000100:00100000:1.0:1787791131.202302:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268195968 00000100:00100000:1.0:1787791131.202328:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787791131.202335:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195968:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791131.202429:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268195968:12345-0@lo:502:mount.lustre.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.202437:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787791131.204052:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268195968:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791131.204314:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787791131.204346:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1787791131.204362:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1787791131.204376:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1787791131.204392:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1787791131.204408:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1787791131.204422:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1787791131.204437:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1787791131.204451:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1787791131.204466:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1787791131.204479:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1787791131.204517:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787791131.204586:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.204633:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170cea65900 going to sleep for 11 seconds 00000100:00100000:1.0:1787791131.205171:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196096 00000100:00100000:1.0:1787791131.205179:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196096 00000100:00100000:1.0:1787791131.205232:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787791131.205242:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268196096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787791131.205361:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268196096:12345-0@lo:502:mount.lustre.0 Request processed in 120us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.205368:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787791131.205934:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787791131.206008:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1787791131.206020:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787791131.209495:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791131.209509:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209512:0:25030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787791131.209520:0:25030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f4f9c800 00000020:00000080:3.0:1787791131.209523:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791131.209531:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791131.209533:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209535:0:25030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787791131.209537:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791131.209539:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209540:0:25030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787791131.209543:0:25030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9170f4f9c800 00000020:00000080:3.0:1787791131.209545:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791131.209649:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791131.209653:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209654:0:25030:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787791131.209662:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791131.209665:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209666:0:25030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787791131.209670:0:25030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f4f9c800 00000020:00000080:3.0:1787791131.209672:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791131.209690:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791131.209692:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209694:0:25030:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787791131.209702:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787791131.209723:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209725:0:25030:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787791131.209729:0:25030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9170f4f9c800 00000020:00000080:3.0:1787791131.209731:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787791131.209757:0:25030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787791131.209761:0:25030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787791131.209762:0:25030:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787791131.209765:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1787791131.210842:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787791131.210879:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787791131.210901:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.210924:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791131.210994:0:25022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787791131.210997:0:25022:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9170f4f9c800 10000000:01000000:2.0:1787791131.211001:0:25022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9170f4f9c800 10000000:01000000:2.0:1787791131.211006:0:25022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787791131.211012:0:25022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9170f4f9c800 from 1 10000000:01000000:2.0:1787791131.211015:0:25022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787791131.211052:0:25022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211072:0:25022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211083:0:25022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791131.211107:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787791131.211174:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791131.211215:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196224 00000100:00100000:2.0:1787791131.211221:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196224 00000100:00100000:2.0:1787791131.211261:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787791131.211269:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:25022:x1874634268196224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791131.211281:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791131.211294:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3000/0xcf9477fddcf1f69e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f697 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211318:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3000/0xcf9477fddcf1f69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f697 expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211352:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3000/0xcf9477fddcf1f69e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f697 expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211361:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3000, rc 0) 00000100:00100000:2.0:1787791131.211397:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196224:12345-0@lo:101:mount.lustre.0 Request processed in 128us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.211404:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787791131.211449:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3b1e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.211470:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787791131.211484:0:25022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f69e expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791131.211494:0:25022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f69e expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787791131.219372:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1787791131.219791:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791131.220298:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787791131.220331:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1787791131.220349:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1787791131.220364:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1787791131.220379:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1787791131.220395:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1787791131.220408:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1787791131.220419:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1787791131.220432:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787791131.220457:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1787791131.220470:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1787791131.220491:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1787791131.220505:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1787791131.220518:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787791131.220529:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787791131.220540:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787791131.220552:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787791131.220564:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787791131.220578:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787791131.220592:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787791131.220619:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787791131.220630:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787791131.220639:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787791131.220650:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787791131.220661:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787791131.220683:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787791131.220694:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787791131.220898:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787791131.220989:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787791131.221008:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787791131.221021:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787791131.221034:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787791131.221049:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787791131.221261:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787791131.221280:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787791131.221293:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787791131.221304:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787791131.221317:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787791131.221330:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787791131.221344:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787791131.221357:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787791131.221389:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787791131.221406:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787791131.221421:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787791131.221446:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787791131.221460:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787791131.221473:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787791131.221487:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787791131.224084:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787791131.224144:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787791131.224171:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787791131.224178:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787791131.224296:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791131.224366:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791131.224413:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196352 00000100:00100000:2.0:1787791131.224419:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196352 00000100:00100000:2.0:1787791131.224461:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787791131.224470:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791131.224612:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196352:12345-0@lo:501:mount.lustre.0 Request processed in 142us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.224619:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787791131.224684:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3b1e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.224721:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787791131.224950:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787791131.224993:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791131.225007:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc3b1e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.232315:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196480 00000100:00100000:3.0:1787791131.232330:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196480 00000100:00100000:3.0:1787791131.232402:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787791131.232411:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787791131.232577:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196480:12345-0@lo:503:mount.lustre.0 Request processed in 166us (7582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.232584:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787791131.232678:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787791131.233511:0:25022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787791131.233607:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.235350:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.235419:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196608 00000100:00100000:3.0:1787791131.235425:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196608 00000100:00100000:3.0:1787791131.235467:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787791131.235475:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.235621:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196608:12345-0@lo:502:mount.lustre.0 Request processed in 145us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.235628:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787791131.236033:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f7754b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.252925:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791131.253365:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787791131.253398:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787791131.253414:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787791131.253428:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787791131.253441:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787791131.253454:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787791131.253469:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787791131.253483:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787791131.253498:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787791131.253512:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787791131.253527:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787791131.253541:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787791131.253557:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787791131.253834:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787791131.253871:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787791131.253888:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787791131.253902:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787791131.253989:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787791131.254008:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787791131.254024:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787791131.254039:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787791131.254180:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787791131.254205:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787791131.254222:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787791131.254236:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787791131.254251:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787791131.254265:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787791131.254279:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787791131.254294:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787791131.254309:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787791131.254336:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787791131.254359:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787791131.254373:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787791131.254387:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787791131.254402:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787791131.254417:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787791131.254431:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787791131.254444:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787791131.254457:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787791131.254471:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787791131.254485:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787791131.254499:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787791131.254513:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787791131.254528:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787791131.254542:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787791131.254556:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787791131.254996:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787791131.255017:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787791131.255088:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196736:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.255166:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.255210:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f7754b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787791131.257855:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196736 00000100:00100000:2.0:1787791131.257869:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196736 00000100:00100000:2.0:1787791131.257940:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787791131.257952:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787791131.259404:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196736:12345-0@lo:502:mount.lustre.0 Request processed in 1449us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.259423:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787791131.259474:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791131.259775:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787791131.259805:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787791131.259841:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.259885:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.259932:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f7754b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.259951:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196864 00000100:00100000:3.0:1787791131.259956:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196864 00000100:00100000:3.0:1787791131.259994:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787791131.260003:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787791131.260120:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268196864:12345-0@lo:502:mount.lustre.0 Request processed in 117us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.260128:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787791131.260167:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268196864:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787791131.260201:0:25022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787791131.260208:0:25022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787791131.262517:0:25035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787791131.262533:0:25035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9170eef519b8) 00000020:00000080:3.0:1787791131.262559:0:25035:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787791131.262826:0:25035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f4f9c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787791131.262831:0:25035:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f4f9c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787791131.262833:0:25035:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f4f9c800 3 00010000:00080000:3.0:1787791131.262864:0:25035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc31aa000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787791131.267281:0:25035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787791131.267502:0:25035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787791131.267551:0:25035:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787791131.267565:0:25035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf9477fddcf1f6ac 00000100:00080000:3.0:1787791131.267576:0:25035:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787791131.267582:0:25035:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff916fc31aa000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791131.267630:0:25035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4d5a1c0 x1874634268196992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791131.267675:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268196992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791131.268555:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.268821:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268196992 00000100:00100000:0.0:1787791131.268831:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268196992 00000100:00080000:3.0:1787791131.268877:0:25035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787791131.268927:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791131.268937:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1874634268196992:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787791131.268946:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791131.268951:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787791131.268963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791131.268968:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787791131.268987:0:22700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000100:00080000:3.0:1787791131.269011:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787791131.269015:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787791131.269019:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787791131.269024:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 675 00000020:00000080:0.0:1787791131.269025:0:22700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf9477fddcf1f6b3 00000100:00080000:3.0:1787791131.269029:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787791131.269036:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170c7da2000 using connection 192.168.202.122@tcp/0@lo 00000004:00100000:0.0:1787791131.269042:0:22700:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787791131.269074:0:22700:0:(import.c:65:import_set_state_nolock()) ffff9170c710b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791131.269127:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874634268196992:12345-0@lo:38:llog_process_th.0 Request processed in 190us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.269134:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787791131.269581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170e4d583c0 x1874634268197632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787791131.269814:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268197248:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.269855:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268197120:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.269893:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.269983:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.269987:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268197760:0@lo:400:kworker.0 00000100:00100000:0.0:1787791131.270014:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268197888:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.270021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.270049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.270181:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268197504:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.270210:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.270232:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787791131.270238:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268197376:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.270257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.270273:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268198016:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.270290:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.270492:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268197632:0@lo:8:kworker.0 00000100:00100000:0.0:1787791131.270520:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787791131.270567:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5a1c0 x1874634268196992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791131.270576:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791131.270585:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787791131.270602:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787791131.270607:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787791131.270610:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc31aa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787791131.270616:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1874634268196992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787791131.270648:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197248 00000100:00100000:0.0:1787791131.270653:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197248 00000100:00100000:0.0:1787791131.270689:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197760 00000100:00100000:0.0:1787791131.270692:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197760 00000100:00100000:1.0:1787791131.270821:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197504 00000100:00100000:1.0:1787791131.270826:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197504 00000100:00100000:1.0:1787791131.270867:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197632 00000100:00100000:1.0:1787791131.270871:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197632 00000100:00100000:1.0:1787791131.270892:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787791131.270901:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268197504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791131.270952:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268197504:12345-0@lo:400:kworker.0 Request processed in 52us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791131.270959:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787791131.271828:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787791131.271835:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634268197632:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787791131.273168:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3637:x1874634268197632:12345-0@lo:8:kworker.0 Request processed in 1324us (2639us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787791131.273180:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787791131.273209:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791131.273816:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197120 00000100:00100000:3.0:1787791131.273826:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197120 00000100:00100000:3.0:1787791131.273865:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197376 00000100:00100000:3.0:1787791131.273875:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197376 00000100:00100000:3.0:1787791131.273895:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787791131.273903:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.274047:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268197120:12345-0@lo:400:kworker.0 Request processed in 144us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.274179:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787791131.274199:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787791131.274206:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268197376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.274244:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268197376:12345-0@lo:400:kworker.0 Request processed in 39us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.274250:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787791131.274301:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268197376:0@lo:400:kworker.0 00010000:00080000:3.0:1787791131.274319:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5ad00 x1874634268197504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791131.274330:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268197504:0@lo:400:kworker.0 00000100:00100000:3.0:1787791131.274371:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268197120:0@lo:400:kworker.0 00000020:01000004:3.0:1787791131.275589:0:25035:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787791131.275625:0:25035:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff916fc38b19b8) 00000020:00000080:3.0:1787791131.275669:0:25035:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1787791131.275781:0:25035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9170f4f9c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787791131.275786:0:25035:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9170f4f9c800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787791131.275789:0:25035:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9170f4f9c800 3 00010000:00080000:3.0:1787791131.275823:0:25035:0:(ldlm_lib.c:102:import_set_conn()) imp ffff916fc31a8000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.122@tcp at head 00000100:00100000:0.0:1787791131.277054:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268197888 00000100:00100000:0.0:1787791131.277066:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268197888 00000100:00100000:0.0:1787791131.277103:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198016 00000100:00100000:0.0:1787791131.277107:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198016 00000100:00100000:0.0:1787791131.277130:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791131.277142:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268197248:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1787791131.277581:0:25035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:0.0:1787791131.277868:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268197248:12345-0@lo:400:kworker.0 Request processed in 729us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.277877:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791131.277897:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787791131.277904:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268197760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791131.277943:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268197760:12345-0@lo:400:kworker.0 Request processed in 40us (7923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.277948:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787791131.277958:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787791131.277964:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268197888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791131.277990:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874634268197888:12345-0@lo:400:kworker.0 Request processed in 27us (7942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.277996:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787791131.278007:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787791131.278013:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268198016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791131.278048:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268198016:12345-0@lo:400:kworker.0 Request processed in 35us (7756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.278054:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787791131.278113:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791131.278123:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791131.278127:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787791131.278139:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d583c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268197632:0@lo:8:kworker.0 00010000:00080000:2.0:1787791131.278265:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170e4d5b480 x1874634268197248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791131.278279:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268197248:0@lo:400:kworker.0 00010000:00080000:2.0:1787791131.278294:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbdcb840 x1874634268197888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791131.278303:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1874634268197888:0@lo:400:kworker.0 00010000:00080000:3.0:1787791131.279225:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbdc92c0 x1874634268197760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791131.279256:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268197760:0@lo:400:kworker.0 00010000:00080000:3.0:1787791131.279293:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbdcad00 x1874634268198016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791131.279303:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268198016:0@lo:400:kworker.0 00000020:00000080:3.0:1787791131.279548:0:25035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000100:00080000:0.0:1787791131.279831:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787791131.279837:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000010:01000000:3.0:1787791131.282297:0:25035:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787791131.282316:0:25035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf9477fddcf1f6c1 00000100:00080000:3.0:1787791131.282329:0:25035:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787791131.282336:0:25035:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff916fc31a8000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787791131.282376:0:25035:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9170fbdcad00 x1874634268198144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787791131.282413:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268198144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787791131.282506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791131.282586:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198144 00000100:00100000:3.0:1787791131.282601:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198144 00000100:00100000:3.0:1787791131.282649:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787791131.282664:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1874634268198144:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787791131.282693:0:24230:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 680 last 0 00000020:00000080:3.0:1787791131.282843:0:24230:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf9477fddcf1f6c8 00000004:00100000:3.0:1787791131.282861:0:24230:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787791131.282898:0:24230:0:(import.c:65:import_set_state_nolock()) ffff9170c3537000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791131.283019:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874634268198144:12345-0@lo:38:llog_process_th.0 Request processed in 361us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.283027:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787791131.283071:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9170fbdcad00 x1874634268198144/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787791141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791131.283453:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787791131.283462:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1787791131.283471:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787791131.283475:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787791131.283477:0:3637:0:(import.c:65:import_set_state_nolock()) ffff916fc31a8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787791131.283485:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1874634268198144:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787791131.283512:0:25035:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787791131.284331:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791131.284340:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787791131.284344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791131.284347:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1787791131.288462:0:25035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1787791131.288971:0:25022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787791131.289021:0:25022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787791131.289045:0:25022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f69e expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.289056:0:25022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d2200/0xcf9477fddcf1f697 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f69e expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787791131.289115:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787791131.289118:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787791131.289119:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791131.289121:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791131.289122:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791131.289128:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791131.289129:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791131.289131:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791131.289133:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787791131.289137:0:25022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787791131.289140:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787791131.289142:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787791131.289143:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787791131.289145:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787791131.289146:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787791131.289147:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787791131.289152:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787791131.289153:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787791131.289160:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787791131.289203:0:25022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787791131.289232:0:25022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268198272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787791131.289332:0:25022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.289405:0:25022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c83cbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787791131.289637:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198272 00000100:00100000:3.0:1787791131.289650:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198272 00000100:00100000:3.0:1787791131.289737:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787791131.289749:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268198272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787791131.289776:0:22695:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787791131.289791:0:22695:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787791131.303317:0:22695:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787791131.303337:0:22695:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787791131.303831:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:25022:x1874634268198272:12345-0@lo:253:mount.lustre.0 Request processed in 13953us (14368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791131.303845:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787791131.304009:0:25022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:25022:1874634268198272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787791131.304023:0:25022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787791131.304026:0:25022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787791131.304028:0:25022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787791131.304029:0:25022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787791131.304030:0:25022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787791131.304031:0:25022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787791131.304033:0:25022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787791131.304034:0:25022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787791131.304035:0:25022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787791131.304037:0:25022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787791131.304051:0:25022:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787791131.304536:0:22716:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787791131.304541:0:22716:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787791131.304563:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.304578:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.304585:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.304601:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.304640:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.304656:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 23 pid: 22694 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.304675:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268198400:0@lo:104: 00000100:00100000:0.0:1787791131.306036:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791131.306113:0:22716:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.306126:0:22716:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.306138:0:22716:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d583c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268198528:0@lo:104: 00000100:00100000:0.0:1787791131.306167:0:22716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.306189:0:22716:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d01c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787791131.306229:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198400 00000100:00100000:0.0:1787791131.306237:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198400 00000100:00100000:0.0:1787791131.306277:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198528 00000100:00100000:0.0:1787791131.306280:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198528 00000100:00100000:0.0:1787791131.306300:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791131.306312:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268198400:12345-0@lo:104: 00010000:00010000:0.0:1787791131.306325:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.306389:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787791131.306648:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268198400:0@lo:104: 00010000:00010000:1.0:1787791131.306818:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791131.306832:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.306842:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2000 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791131.306846:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.306855:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791131.306861:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791131.306867:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787791131.306901:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.306907:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791131.306926:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.306933:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2000/0xcf9477fddcf1f64a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f651 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.306944:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791131.306946:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791131.306947:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791131.307810:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:22716:x1874634268198400:12345-0@lo:104: Request processed in 1426us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.307824:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791131.307860:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787791131.307870:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268198528:12345-0@lo:104: 00010000:00010000:0.0:1787791131.307882:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.307962:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787791131.307968:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:22716:x1874634268198528:12345-0@lo:104: Request processed in 102us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.307975:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787791131.307994:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787791131.308010:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268198656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791131.308049:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791131.308086:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791131.308093:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308113:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d3600 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:0.0:1787791131.308117:0:22689:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308126:0:22689:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787791131.308132:0:22689:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791131.308138:0:22689:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787791131.308160:0:22689:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308167:0:22689:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787791131.308186:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308194:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f63c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f643 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308210:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791131.308212:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791131.308214:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791131.308228:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198656 00000100:00100000:0.0:1787791131.308234:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198656 00010000:00010000:0.0:1787791131.308253:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 24 pid: 22694 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.308274:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791131.308288:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3640:x1874634268198656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791131.308298:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791131.308303:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 24 pid: 22694 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308314:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 24 pid: 22694 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308327:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f64a expref: 24 pid: 22694 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.308339:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791131.308367:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:3640:x1874634268198656:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.308373:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787791131.308859:0:22716:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d583c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22716:1874634268198528:0@lo:104: 00010000:00010000:1.0:1787791131.308888:0:22716:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.309042:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268198784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791131.309078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791131.309126:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198784 00000100:00100000:0.0:1787791131.309130:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198784 00010000:00010000:0.0:1787791131.309147:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.309177:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787791131.309184:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:3638:x1874634268198784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791131.309192:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791131.309197:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309207:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309226:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc26fa800/0xcf9477fddcf1f643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f63c expref: 23 pid: 22693 timeout: 780 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309238:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309246:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787791131.309260:0:22686:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012436198s 00010000:00010000:0.0:1787791131.309264:0:22686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309271:0:22686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309278:0:22686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309285:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309290:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791131.309294:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309302:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309319:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791131.309334:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791131.309362:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:3638:x1874634268198784:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791131.309369:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787791131.309828:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4d59e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268198784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791131.309854:0:22716:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.309866:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791131.309874:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9f000/0xcf9477fddcf1f6cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791131.312169:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268198656:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1787791131.314670:0:25022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1787791131.323579:0:25022:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787791131.323590:0:25022:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787791131.323638:0:25022:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787791131.323693:0:25022:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787791131.323745:0:25022:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787791131.323775:0:25022:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787791131.324624:0:25022:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787791131.324899:0:25022:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787791131.541041:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791131.984282:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787791131.984314:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268198912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791131.984418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791131.984488:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268198912 00000100:00100000:2.0:1787791131.984497:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268198912 00000100:00100000:2.0:1787791131.984567:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787791131.984580:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268198912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787791131.984647:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787791131.984730:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268198912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791131.984739:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787791131.984793:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3766940 x1874634268198912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787791147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791131.984816:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268198912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791132.301685:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791112/real 1787791112] req@ffff916fc3b92d00 x1874634268185344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791132.303546:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3b92d00 x1874634268185344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791132.303569:0:3637:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787791112/real 1787791112] req@ffff916fc3b91e00 x1874634268185472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791132 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791132.303582:0:3637:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff916fc3b91e00 x1874634268185472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787791132 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787791132.303619:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787791132.303833:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791132.303839:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268185344:0@lo:8:kworker.0 00000100:00080000:0.0:1787791132.303847:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787791132.304152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791132.304156:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787791132.304159:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791132.304164:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:1.0:1787791132.304171:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787791132.304179:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9170f5039000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791132.304202:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b90b40 x1874634268199296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791132.304213:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791132.304216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787791132.304218:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791132.304221:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 661 00000100:00080000:1.0:1787791132.304236:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787791132.304241:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9170f3c7e000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791132.304255:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b90f00 x1874634268199424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787791132.304304:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787791132.304307:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787791132.304309:0:37:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787791132.304315:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9170c7da2000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787791132.304328:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff916fc3b93c00 x1874634268199936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787791132.304390:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268199040:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304480:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304531:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268199808:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304596:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268200448:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304661:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787791132.304668:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268199168:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304749:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268200064:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304771:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304790:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268200576:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304847:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268199552:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304887:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268200192:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304907:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304936:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787791132.304942:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268199680:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.304967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.304986:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268200320:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305008:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.305040:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199040 00000100:00100000:1.0:1787791132.305049:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199040 00000100:00100000:1.0:1787791132.305108:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787791132.305119:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:3640:x1874634268199040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305177:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:3640:x1874634268199040:12345-0@lo:400:kworker.0 Request processed in 59us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305184:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787791132.305224:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199808 00000100:00100000:1.0:1787791132.305228:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199808 00000100:00100000:1.0:1787791132.305256:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791132.305263:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268199808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305296:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268199808:12345-0@lo:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305301:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787791132.305319:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200448 00000100:00100000:1.0:1787791132.305322:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200448 00000100:00100000:1.0:1787791132.305357:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200064 00000100:00100000:1.0:1787791132.305361:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200064 00000100:00100000:1.0:1787791132.305372:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200576 00000100:00100000:1.0:1787791132.305375:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200576 00000100:00100000:1.0:1787791132.305386:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199552 00000100:00100000:1.0:1787791132.305388:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199552 00000100:00100000:1.0:1787791132.305398:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200192 00000100:00100000:1.0:1787791132.305400:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200192 00000100:00100000:1.0:1787791132.305422:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200320 00000100:00100000:1.0:1787791132.305425:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200320 00000100:00100000:1.0:1787791132.305437:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791132.305443:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268200448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305478:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874634268200448:12345-0@lo:400:kworker.0 Request processed in 35us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305485:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787791132.305497:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787791132.305504:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268200064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305531:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874634268200064:12345-0@lo:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305538:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787791132.305549:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787791132.305555:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268200576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305599:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874634268200576:12345-0@lo:400:kworker.0 Request processed in 29us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305605:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787791132.305617:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791132.305623:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305664:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874634268199552:12345-0@lo:400:kworker.0 Request processed in 41us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305670:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787791132.305682:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787791132.305688:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268200192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305743:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874634268200192:12345-0@lo:400:kworker.0 Request processed in 55us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305759:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787791132.305772:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787791132.305778:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268200320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305806:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268200320:12345-0@lo:400:kworker.0 Request processed in 28us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305812:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787791132.305835:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199168 00000100:00100000:1.0:1787791132.305839:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199168 00000100:00100000:1.0:1787791132.305858:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199680 00000100:00100000:1.0:1787791132.305861:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199680 00000100:00100000:1.0:1787791132.305874:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787791132.305880:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268199168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305913:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268199168:12345-0@lo:400:kworker.0 Request processed in 33us (1219us total) trans 0 rc 0/0 00010000:00080000:3.0:1787791132.305915:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d4000 x1874634268200320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.305919:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787791132.305931:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787791132.305933:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268200320:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.305937:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268199680:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787791132.305945:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b92940 x1874634268199552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.305961:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268199680:12345-0@lo:400:kworker.0 Request processed in 25us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.305967:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787791132.305968:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874634268199552:0@lo:400:kworker.0 00010000:00080000:3.0:1787791132.305980:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170ff5d43c0 x1874634268200192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791132.305988:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170ff5d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1874634268200192:0@lo:400:kworker.0 00000100:00080000:1.0:1787791132.306012:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787791132.306017:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268199680:0@lo:400:kworker.0 00000100:00080000:1.0:1787791132.306017:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787791132.306035:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268199168:0@lo:400:kworker.0 00010000:00080000:1.0:1787791132.306046:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b903c0 x1874634268200064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.306055:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874634268200064:0@lo:400:kworker.0 00010000:00080000:1.0:1787791132.306076:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458b0c0 x1874634268200576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.306083:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1874634268200576:0@lo:400:kworker.0 00000100:00100000:1.0:1787791132.306091:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268199040:0@lo:400:kworker.0 00010000:00080000:1.0:1787791132.306100:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b91a40 x1874634268199808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.307554:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268199808:0@lo:400:kworker.0 00010000:00080000:1.0:1787791132.307614:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458b840 x1874634268200448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787791132.307626:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1874634268200448:0@lo:400:kworker.0 00000100:00080000:0.0:1787791132.313557:0:3637:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787791132.313572:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268185472:0@lo:8:kworker.0 00000100:00100000:0.0:1787791132.313636:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268199296:0@lo:8:kworker.0 00000100:00100000:0.0:1787791132.313768:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791132.314172:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199296 00000100:00100000:3.0:1787791132.314183:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199296 00000100:00100000:3.0:1787791132.314230:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787791132.314241:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1874634268199296:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787791132.314283:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1787791132.314326:0:24827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f6d6 00002000:00100000:3.0:1787791132.314346:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff916fc31ab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787791132.314352:0:24827:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787791132.314355:0:24827:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1787791132.316460:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268199424:0@lo:8:kworker.0 00000100:00100000:0.0:1787791132.316580:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.316656:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268199936:0@lo:8:kworker.0 00000100:00100000:0.0:1787791132.316683:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1787791132.316765:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787791132.316812:0:24827:0:(import.c:65:import_set_state_nolock()) ffff916fc31ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791132.316895:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d59e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268199296:12345-0@lo:8:kworker.0 Request processed in 2652us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.316908:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787791132.316936:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199424 00000100:00100000:3.0:1787791132.316944:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199424 00000100:00100000:3.0:1787791132.316965:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268199936 00000100:00100000:3.0:1787791132.316968:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268199936 00000100:00100000:3.0:1787791132.316982:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787791132.316990:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1874634268199424:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787791132.317039:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1787791132.317077:0:24827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf9477fddcf1f6dd 00002000:00100000:3.0:1787791132.317094:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff916fc31a8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787791132.317099:0:24827:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787791132.317103:0:24827:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787791132.317289:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787791132.317304:0:24827:0:(import.c:65:import_set_state_nolock()) ffff916fc31ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791132.317335:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d583c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874634268199424:12345-0@lo:8:kworker.0 Request processed in 345us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.317343:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787791132.317357:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787791132.317361:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3637:x1874634268199936:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787791132.317376:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 681 last 0 00000020:00000080:3.0:1787791132.317393:0:24827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf9477fddcf1f6e4 00002000:00100000:3.0:1787791132.317398:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff916fc31af000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113932 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787791132.317402:0:24827:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787791132.317404:0:24827:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787791132.317439:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787791132.317576:0:24827:0:(import.c:65:import_set_state_nolock()) ffff916fc31ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791132.317620:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc44621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3637:x1874634268199936:12345-0@lo:8:kworker.0 Request processed in 257us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.317628:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787791132.319057:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b90b40 x1874634268199296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791132.319073:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791132.319085:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787791132.319095:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787791132.319102:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787791132.319104:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f5039000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787791132.319131:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787791132.319138:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268199296:0@lo:8:kworker.0 00010000:00080000:0.0:1787791132.319155:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b90f00 x1874634268199424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787791132.319162:0:22724:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787791132.319163:0:3637:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787791132.319168:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787791132.319173:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787791132.319176:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787791132.319178:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170f3c7e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787791132.319194:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787791132.319213:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b90f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1874634268199424:0@lo:8:kworker.0 00000004:00080000:3.0:1787791132.319289:0:22724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 681267582904ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787791132.319296:0:22724:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1787791132.319348:0:22727:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787791132.319377:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22727:1874634268200832:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787791132.319443:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.319477:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2dad840 going to sleep for 11 seconds 00000004:00080000:0.0:1787791132.319493:0:22726:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787791132.319543:0:22726:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 681267837101ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787791132.319548:0:22726:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:0.0:1787791132.319572:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3b93c00 x1874634268199936/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787791157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787791132.319598:0:3637:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1787791132.319605:0:3637:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787791132.319608:0:3637:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787791132.319610:0:3637:0:(import.c:65:import_set_state_nolock()) ffff9170c7da2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787791132.319622:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787791132.319626:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1874634268199936:0@lo:8:kworker.0 00000004:00080000:1.0:1787791132.320434:0:22725:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1787791132.320456:0:22725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22725:1874634268201088:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787791132.320514:0:22725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.320540:0:22725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170f3c5e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787791132.320549:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268200704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787791132.320556:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268200960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787791132.320599:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.320652:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200960 00000100:00100000:1.0:1787791132.320660:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200960 00000100:00100000:1.0:1787791132.320750:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787791132.320762:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268200960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787791132.320791:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791132.320856:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1874634268200960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.320874:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787791132.320905:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787791132.320934:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc458b840 x1874634268200960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791132.320950:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200832 00000100:00100000:1.0:1787791132.320951:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268200960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787791132.320953:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200832 00000100:00100000:3.0:1787791132.320984:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201088 00000100:00100000:3.0:1787791132.320987:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201088 00000100:00100000:1.0:1787791132.321001:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787791132.321006:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791132.321009:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22727:x1874634268200832:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787791132.321012:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22725:x1874634268201088:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787791132.321222:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787791132.321240:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787791132.322607:0:23444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787791132.322759:0:23444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 681271053516ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787791132.322768:0:23444:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1787791132.322861:0:23445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1787791132.322893:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268201344:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1787791132.322964:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.322997:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2dad900 going to sleep for 11 seconds 00000100:00100000:3.0:1787791132.324290:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268200704 00000100:00100000:3.0:1787791132.324308:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268200704 00000100:00100000:3.0:1787791132.324377:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791132.324388:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874634268200704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787791132.324433:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787791132.324534:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1874634268200704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (3293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.324542:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791132.324577:0:24206:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787791132.324598:0:24206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:3.0:1787791132.324644:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9170c9968b40 x1874634268200704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791132.324670:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170c9968b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268200704:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787791132.324750:0:22680:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787791132.324911:0:24827:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787791132.324920:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201344 00000100:00100000:3.0:1787791132.324924:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201344 00000100:00080000:3.0:1787791132.324963:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787791132.332724:0:22680:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787791132.333030:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787791132.333062:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268201216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791132.333161:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1787791132.333528:0:24207:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787791132.333540:0:24207:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1787791132.333563:0:24207:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000004:00080000:0.0:1787791132.334035:0:23434:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:1.0:1787791132.339893:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791132.339914:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23445:x1874634268201344:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787791132.343874:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201216 00000100:00100000:2.0:1787791132.343897:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201216 00000100:00100000:2.0:1787791132.343995:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787791132.344008:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874634268201216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787791132.344046:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787791132.344198:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1874634268201216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (11037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791132.344206:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787791132.344454:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a55e00 x1874634268201216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787791148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791132.344480:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a55e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268201216:0@lo:13:osp-pre-1-1.0 00002000:00010000:3.0:1787791132.351914:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.351930:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.351949:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.351954:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.351961:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.351985:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.351996:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352005:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352028:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.352044:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.352050:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352058:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fac00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.352062:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352081:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352099:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352107:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f6eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.352126:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.352127:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.352129:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.353015:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.353022:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353034:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.353037:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.353042:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353052:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353060:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353073:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353092:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.353102:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.353107:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353114:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fba00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.353118:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353126:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353138:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353145:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a686fd/0xcf9477fddcf1f6f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353161:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.353163:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.353165:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.353890:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.353905:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353916:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.353919:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.353925:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353935:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353943:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353950:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.353975:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.354489:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.354499:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.354515:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fbe00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.354521:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.354530:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.354550:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.354557:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e480451/0xcf9477fddcf1f6f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.354575:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.354576:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.354578:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.354853:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.354859:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.354870:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.354874:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.354879:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.354890:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.354905:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.354912:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.354930:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787791132.356746:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.356881:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.356891:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.356902:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.356907:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.356917:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.356948:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.356956:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e67548b/0xcf9477fddcf1f700 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.356973:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.356975:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.356977:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.357013:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.357025:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.357030:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.357037:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.357049:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.357057:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.357065:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787791132.357292:0:24208:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787791132.357303:0:24208:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:1.0:1787791132.357309:0:24208:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00010000:00010000:3.0:1787791132.359665:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787791132.366123:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787791132.366132:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170ce838000 from 14 10000000:01000000:2.0:1787791132.366137:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787791132.366188:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.366201:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.366229:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791132.366258:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791132.366335:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791132.366387:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc36ee900 going to sleep for 11 seconds 00010000:00010000:0.0:1787791132.366858:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.366868:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.366879:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.366883:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.366894:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.366916:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.366924:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005aa655a8/0xcf9477fddcf1f707 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.366967:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.366969:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.366971:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787791132.369209:0:25087:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787791132.369219:0:25087:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787791132.369356:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23445:x1874634268201344:12345-0@lo:7:osp-pre-1-1.0 Request processed in 29445us (46388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791132.369367:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787791132.371183:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201472 00000100:00100000:3.0:1787791132.371198:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201472 00000100:00100000:3.0:1787791132.371253:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787791132.371264:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268201472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791132.371282:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791132.371303:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f70e expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371333:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f70e expref: 23 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371346:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb800/0xcf9477fddcf1f715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f70e expref: 23 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371356:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb800, rc 0) 00000100:00100000:3.0:1787791132.371424:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268201472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.371432:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00002000:00010000:3.0:1787791132.371533:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.371541:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371557:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.371561:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.371567:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371605:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371617:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371625:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371647:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787791132.371856:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201472:0@lo:101:ll_cfg_requeue.0 00002000:00010000:1.0:1787791132.371863:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.371869:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.371873:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f715 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371878:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.371881:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.371882:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f715 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371885:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371897:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371911:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371918:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371930:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787791132.371939:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787791132.371944:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.371948:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201600:0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1787791132.371952:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26faa00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.371956:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371966:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.371982:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.371987:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787791132.372003:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ea7cb2c/0xcf9477fddcf1f71c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372016:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118aa80 going to sleep for 11 seconds 00010000:00010000:1.0:1787791132.372022:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.372030:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372031:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201600 00000100:00100000:3.0:1787791132.372035:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201600 00010000:00010000:1.0:1787791132.372038:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.372041:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372049:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372058:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00010000:00010000:1.0:1787791132.372060:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372063:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268201600:12345-0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1787791132.372068:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f5d34c5/0xcf9477fddcf1f723 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787791132.372077:0:22694:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00010000:00010000:1.0:1787791132.372079:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.372081:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.372083:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1787791132.372096:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787791132.372099:0:22694:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1787791132.372170:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268201600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.372178:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787791132.372207:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787791132.372294:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787791132.372302:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f715 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372310:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170f39d3600/0xcf9477fddcf1f70e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f715 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791132.372320:0:22697:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787791132.372323:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9170f39e2000 from 14 10000000:01000000:3.0:1787791132.372326:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787791132.372346:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372354:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372362:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372375:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787791132.372400:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791132.372415:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791132.372426:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201728 00000100:00100000:3.0:1787791132.372436:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201728 00000100:00100000:3.0:1787791132.372466:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787791132.372473:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268201728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791132.372480:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791132.372489:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f72a expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372504:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f72a expref: 24 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372512:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc26fb600/0xcf9477fddcf1f731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f72a expref: 24 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372520:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc26fb600, rc 0) 00000100:00100000:3.0:1787791132.372548:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268201728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.372553:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787791132.372614:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791132.372624:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f731 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.372632:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f731 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372667:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201856:0@lo:256:ll_cfg_requeue.0 00002000:00010000:1.0:1787791132.372685:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.372692:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.372693:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787791132.372701:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.372775:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.372780:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372800:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372808:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372815:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372828:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.372836:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.372840:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372846:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.372849:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372857:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372869:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372876:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c256b64/0xcf9477fddcf1f738 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.372893:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.372894:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.372896:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.373338:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.373345:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373353:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.373357:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.373361:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373372:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373379:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373387:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373400:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.373407:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.373411:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373429:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.373432:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373439:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373451:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373457:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ab39f83/0xcf9477fddcf1f73f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.373469:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.373471:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.373473:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791132.373751:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170d118aa80 going to sleep for 11 seconds 00002000:00010000:3.0:1787791132.373809:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.373820:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.373829:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.373832:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.373836:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.373847:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.373855:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.373863:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.373882:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.373978:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.373984:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791132.374000:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201856 00000100:00100000:3.0:1787791132.374007:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201856 00000100:00100000:3.0:1787791132.374044:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787791132.374053:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268201856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787791132.374073:0:22694:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787791132.374088:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787791132.374091:0:22694:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00010000:00010000:1.0:1787791132.374674:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fac00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.374679:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.374687:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787791132.374878:0:23445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a54b40 x1874634268201344/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787791148 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791132.374893:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268201344:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787791132.374906:0:23445:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787791132.374945:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268201984:0@lo:5:osp-pre-1-1.0 00010000:00010000:1.0:1787791132.374982:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375001:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d887615/0xcf9477fddcf1f746 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375023:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.375025:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.375027:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.375092:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.375098:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375107:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.375111:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.375117:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375128:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375137:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375144:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375172:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.375181:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.375185:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375191:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.375194:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375202:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375212:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375220:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b33eb01e/0xcf9477fddcf1f74d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.375234:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.375235:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.375237:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.378195:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.378210:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378227:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.378244:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.378251:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378264:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378274:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378282:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378299:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.378311:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.378316:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378323:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.378327:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378335:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378350:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378368:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053216abd/0xcf9477fddcf1f754 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378387:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.378389:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.378390:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.378861:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.378867:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378875:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.378878:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.378882:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378891:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378899:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378905:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378918:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.378926:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.378937:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378943:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d5400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.378945:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378952:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378963:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378969:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000287edc04/0xcf9477fddcf1f75b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.378982:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.378983:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.378985:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.381542:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.381554:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381569:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.381573:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.381579:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381620:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381632:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381639:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381659:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.381673:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.381678:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381687:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.381691:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381700:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381736:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381744:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000425ee6c2/0xcf9477fddcf1f762 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.381766:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.381768:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.381770:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.382412:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.382419:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.382428:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.382431:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.382436:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.382446:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.382454:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.382462:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.382521:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787791132.382929:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.382968:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2dad900 going to sleep for 11 seconds 00000100:00100000:1.0:1787791132.383060:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268201984 00000100:00100000:1.0:1787791132.383070:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268201984 00000100:00100000:1.0:1787791132.383116:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791132.383124:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23445:x1874634268201984:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787791132.383160:0:24827:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1787791132.383212:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23445:x1874634268201984:12345-0@lo:5:osp-pre-1-1.0 Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791132.383219:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791132.383264:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268201984:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787791132.383275:0:23445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1787791132.383323:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268202112:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1787791132.383355:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791132.383372:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170face4b40 going to sleep for 11 seconds 00002000:00010000:0.0:1787791132.383466:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.383473:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.383483:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.383487:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.383493:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.383505:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.383515:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.383534:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383608:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787791132.383617:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383624:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791132.383629:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383638:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383657:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383663:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000376a2b7b/0xcf9477fddcf1f769 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383688:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791132.383692:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383698:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fe00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791132.383701:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383740:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383751:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.383759:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.383761:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.383762:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791132.383775:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202112 00000100:00100000:2.0:1787791132.383779:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202112 00000100:00100000:2.0:1787791132.383808:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787791132.383815:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23445:x1874634268202112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787791132.383839:0:25087:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:3.0:1787791132.389242:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268201856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 15181us (16538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.389259:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787791132.389337:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdc8780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268201856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787791132.389408:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787791132.389420:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f731 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389431:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc26fb200/0xcf9477fddcf1f72a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f731 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389452:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.389539:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.389547:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389562:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.389568:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.389575:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389601:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389611:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389618:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.389639:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787791132.389647:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791132.389655:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.389674:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791132.389679:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.389688:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787791132.390085:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.390092:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390100:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.390103:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.390108:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390117:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390124:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390130:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390142:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787791132.390178:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390188:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f1a3ed7/0xcf9477fddcf1f777 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390205:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791132.390209:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390217:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791132.390220:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390223:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.390228:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390239:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390251:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c9db75e/0xcf9477fddcf1f77e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.390264:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.390266:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.390267:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.390500:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.390507:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390515:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.390518:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.390522:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390541:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390550:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390557:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390570:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.390656:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.390662:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390670:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.390673:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390682:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390694:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390702:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f785 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390744:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.390746:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.390748:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.390939:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.390945:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390954:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.390957:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.390961:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390970:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390978:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.390985:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.391012:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.391031:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.391037:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.391044:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.391048:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.391056:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.391068:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.391075:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2695dc4/0xcf9477fddcf1f78c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.391100:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.391102:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.391104:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.391303:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.391309:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.391327:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.391329:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.391334:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.391343:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.391351:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.391358:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.391417:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.391425:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f770 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787791132.391966:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.391972:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.391981:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.391984:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.391988:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.391996:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.392002:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.392008:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1787791132.394468:0:25090:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787791132.394784:0:25090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787791132.397263:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787791132.397279:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397295:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.397301:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397314:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397335:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397344:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.397348:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397355:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.397358:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397382:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397392:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.397399:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.397400:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.397402:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.401006:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.402482:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791132.402493:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f79a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787791132.403267:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.403277:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.403293:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.403298:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.403305:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.403319:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.403329:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.403336:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.407041:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.407055:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.407069:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.407074:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.407085:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.407107:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.407118:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.407119:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.407127:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.407968:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791132.407978:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f7a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.408331:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787791132.408339:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f793 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787791132.408742:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.408749:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.408762:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.408766:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.408772:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.408784:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.408792:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.408800:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787791132.409494:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787791132.409503:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.409513:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1787791132.409517:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787791132.409523:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.409535:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.409543:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.409550:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409627:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787791132.409635:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409643:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fc00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.409647:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409656:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409672:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409681:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.409684:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409690:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.409693:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409700:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409724:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.409752:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.409753:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.409755:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.410829:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787791132.410839:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005521f6e7/0xcf9477fddcf1f7a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.410868:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.411323:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.411329:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411346:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.411349:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.411356:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411368:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411378:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411386:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411404:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.411414:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.411419:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411426:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fe00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.411431:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411438:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411462:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411469:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f7b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.411481:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.411483:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.411484:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.412519:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.412528:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.412540:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.412544:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.412549:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.412561:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.412569:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.412577:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.412616:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.412860:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.412867:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.412875:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.412880:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.412898:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.412914:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.412922:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7aba92e/0xcf9477fddcf1f7bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.412940:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.412941:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.412943:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.413143:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.413149:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.413158:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.413161:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.413166:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.413175:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.413183:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.413190:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.413204:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.413211:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.413216:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.414318:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.414332:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.414342:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.414359:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.414366:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007edd6a67/0xcf9477fddcf1f7c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.414386:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.414387:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.414390:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.414853:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787791132.414862:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f7af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.414886:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787791132.415377:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787791132.415384:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.415395:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1787791132.415399:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787791132.415404:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.415417:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.415425:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.415432:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.415451:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.416370:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.416380:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416390:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.416395:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416404:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416420:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416434:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df050eb0/0xcf9477fddcf1f7cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416453:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.416455:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.416456:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.416509:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.416515:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416524:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.416527:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.416532:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416543:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416550:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416558:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.416580:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787791132.417399:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787791132.417417:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.417426:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791132.417430:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.417439:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.417455:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.417463:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7cec137/0xcf9477fddcf1f7d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.417481:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.417483:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791132.417485:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.418426:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.418447:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418460:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.418465:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.418472:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418485:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418494:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418502:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418518:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.418527:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.418533:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418540:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.418544:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418552:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418572:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418579:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d18a752d/0xcf9477fddcf1f7d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.418606:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.418607:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.418609:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.420795:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.420810:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.420826:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.420830:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.420837:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.420850:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.420860:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.420868:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.420901:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:0.0:1787791132.426046:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:0.0:1787791132.426085:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1787791132.426092:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787791132.426322:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23445:x1874634268202112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 42502us (42960us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787791132.426334:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787791132.426484:0:23445:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787791132.426493:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23445:1874634268202112:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1787791132.426511:0:23445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1787791132.426576:0:23445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23445:1874634268202240:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1787791132.426629:0:23445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.426663:0:23445:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1180 going to sleep for 11 seconds 00002000:00010000:1.0:1787791132.427308:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.427318:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.427335:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.427339:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.427347:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.427361:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.427372:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.427379:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.427403:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787791132.427851:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202240 00000100:00100000:3.0:1787791132.427859:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202240 00000100:00100000:3.0:1787791132.427927:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787791132.427936:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23445:x1874634268202240:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1787791132.428009:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23445:x1874634268202240:12345-0@lo:900:osp-pre-1-1.0 Request processed in 75us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791132.428017:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787791132.428056:0:23445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3a54b40 x1874634268202240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787791148 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791132.428068:0:23445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a54b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23445:1874634268202240:0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1787791132.428218:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.428301:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428322:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.428326:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.428332:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428342:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428351:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428357:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428366:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787791132.428665:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.428670:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428678:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.428681:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.428685:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.428694:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428773:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787791132.428782:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428790:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.428794:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428803:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428822:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428831:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8424e2f/0xcf9477fddcf1f7e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428851:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787791132.428854:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428861:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.428864:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428871:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428888:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428895:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094719290/0xcf9477fddcf1f7e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428909:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.428912:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428919:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.428923:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428931:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428941:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428948:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3e86fd6/0xcf9477fddcf1f7ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.428959:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.428960:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.428967:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.429021:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.429026:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429034:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.429037:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.429041:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429050:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429058:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429065:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429080:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.429087:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.429090:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429096:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.429100:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429117:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429129:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429136:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff9fcad1/0xcf9477fddcf1f7fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429151:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.429152:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.429154:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.429611:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.429617:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429625:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.429628:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.429633:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429642:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429650:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429662:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429674:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.429682:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.429686:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429692:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.429695:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429702:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429742:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429749:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f082bd1/0xcf9477fddcf1f803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.429760:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.429762:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.429763:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.430029:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.430041:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430049:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.430052:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.430056:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430065:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430072:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430079:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430090:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.430096:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.430099:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430105:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.430108:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430115:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430131:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430137:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a5cdca/0xcf9477fddcf1f80a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430149:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.430151:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.430152:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.430453:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.430458:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430465:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.430468:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.430472:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430481:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430489:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430496:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430520:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.430526:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.430530:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430535:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.430539:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430546:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430556:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430564:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e16df2b/0xcf9477fddcf1f811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430578:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.430580:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.430591:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.430859:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.430941:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.430946:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430953:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.430961:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.430966:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430975:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430982:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.430988:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.431078:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.431086:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.431108:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787791132.431439:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.431446:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.431454:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.431457:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.431462:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.431471:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.431479:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.431494:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434829:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787791132.434845:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434860:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.434865:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434877:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434899:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434922:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db0fe0ce/0xcf9477fddcf1f818 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434945:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791132.434950:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434956:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.434959:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434967:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434977:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434983:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.434987:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.434993:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.434996:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.435018:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.435029:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.435038:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.435039:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.435041:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.435163:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787791132.435171:0:24208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010b073c8/0xcf9477fddcf1f7f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.435298:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.435888:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.435896:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.435908:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.435914:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.435920:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.435933:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.435941:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.435960:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.435983:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.436237:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.436243:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.436251:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994600 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.436255:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.436264:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.436278:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.436285:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005214f1a4/0xcf9477fddcf1f826 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.436313:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.436314:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.436317:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.436451:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.436457:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.436466:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.436470:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.436475:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.436485:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.436494:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.436501:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.436522:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.436804:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.436810:0:24207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cad2b01/0xcf9477fddcf1f81f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787791132.437113:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.437119:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.437128:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.437132:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.437136:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.437147:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.437155:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.437162:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.437181:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787791132.437368:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.437375:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.437389:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.437392:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.437397:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.437407:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.437416:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.437422:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.437430:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787791132.437701:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787791132.437720:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437737:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.437741:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437749:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437764:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437771:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f77b71d/0xcf9477fddcf1f82d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437787:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791132.437790:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437796:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.437806:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437814:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437825:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437832:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc31b0a5/0xcf9477fddcf1f834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437847:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.437851:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437857:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.437860:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437867:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437878:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437885:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b5e6d4c/0xcf9477fddcf1f83b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.437902:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.437903:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.437905:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.437913:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.438862:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.438873:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.438887:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.438890:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.438898:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.438908:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.438929:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.438937:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.438956:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787791132.439306:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.439313:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.439322:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.439324:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.439328:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.439338:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.439346:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.439353:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.439365:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787791132.439849:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791132.439857:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439866:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.439870:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439879:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439896:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439904:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002bddd3c/0xcf9477fddcf1f842 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439926:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.439930:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439936:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.439946:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439953:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439963:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439970:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1f849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.439986:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.439988:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.439990:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.439996:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.440106:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.440113:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.440123:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.440131:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.440136:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.440146:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.440154:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.440162:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.440180:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787791132.440885:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.440893:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.440903:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.440906:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.440910:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.440921:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.440929:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.440936:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.440962:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787791132.441217:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791132.441294:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441303:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.441308:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441317:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441333:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441345:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093ad16b0/0xcf9477fddcf1f850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441364:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.441367:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441373:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.441376:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441383:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441392:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441400:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000644ba4b9/0xcf9477fddcf1f857 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.441412:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.441413:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.441415:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.441423:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.441871:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.441879:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.441889:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.441893:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.441898:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.441909:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.441917:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.441931:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.441948:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787791132.443335:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.443348:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.443364:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.443368:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.443375:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.443388:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.443398:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.443405:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.443422:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787791132.443740:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.443747:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.443756:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.443759:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.443762:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.443772:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.443781:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.443789:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.443798:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787791132.443951:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787791132.443959:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.443975:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.443979:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.443988:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444004:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444012:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098772a2f/0xcf9477fddcf1f85e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444032:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787791132.444036:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444042:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.444045:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444053:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444062:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444075:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf9a6e3/0xcf9477fddcf1f865 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444089:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.444093:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444099:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.444102:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444109:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444117:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444124:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049380a7c/0xcf9477fddcf1f86c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.444135:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.444137:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.444138:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.444144:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.444569:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.444576:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.444595:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.444605:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.444610:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.444620:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.444627:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.444634:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.444654:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.444827:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.444834:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444848:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.444852:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444859:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444872:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444880:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027cffff/0xcf9477fddcf1f873 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444896:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.444898:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.444900:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787791132.444942:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787791132.444948:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444956:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=681s v=(0 0) 00010000:00010000:3.0:1787791132.444959:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791132.444963:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444972:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444986:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.444993:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.445004:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.445191:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.445197:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.445212:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.445216:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.445234:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.445246:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.445254:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008aad1a22/0xcf9477fddcf1f87a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.445270:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.445272:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.445273:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.445989:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.445997:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.446007:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.446010:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.446015:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.446025:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.446033:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.446046:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.446064:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.446409:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.446415:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.446423:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.446427:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.446435:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.446449:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.446457:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1f881 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.446472:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.446479:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.446481:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.447442:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.447453:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447464:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.447468:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.447474:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447486:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447501:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447508:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447525:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.447535:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.447540:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447548:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.447552:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447559:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447571:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447579:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d18a752d/0xcf9477fddcf1f888 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.447606:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.447613:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.447615:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.448056:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.448063:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448071:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.448074:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.448078:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448086:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448093:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448100:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448117:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.448416:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.448423:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.448430:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.448434:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.448442:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.448457:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.448464:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007edd6a67/0xcf9477fddcf1f88f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.448481:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.448483:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.448484:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787791132.448610:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787791132.448617:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.448625:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:1.0:1787791132.448629:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791132.448634:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.448644:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.448652:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.448659:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.448678:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787791132.448853:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787791132.448858:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448866:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994c00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791132.448869:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448892:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448904:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448911:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6bc3fb7/0xcf9477fddcf1f896 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448926:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.448928:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.448929:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.448973:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.448978:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.448986:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.448989:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.448993:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.449002:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.449010:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.449023:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.449043:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.449377:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.449384:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.449391:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fe00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.449395:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.449410:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.449424:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.449431:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acef3fd3/0xcf9477fddcf1f89d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.449446:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.449448:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.449449:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.450413:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.450423:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.450436:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.450440:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.450446:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.450457:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.450465:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.450472:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.450492:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787791132.450731:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791132.450739:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.450752:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fc00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791132.450757:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.450765:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.450781:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.450789:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005521f6e7/0xcf9477fddcf1f8a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791132.450807:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.450809:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791132.450810:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787791132.452785:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.452799:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.452823:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.452827:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.452834:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.452846:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.452856:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.452863:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.452879:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787791132.453239:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.453247:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.453255:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f400 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.453260:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.453269:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.453290:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.453310:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065376730/0xcf9477fddcf1f8ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.453330:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.453331:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.453333:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787791132.453687:0:24207:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787791132.453695:0:24207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787791132.454349:0:24208:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787791132.454356:0:24208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.454367:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=681s v=(0 0) 00010000:00010000:0.0:1787791132.454372:0:24208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787791132.454377:0:24208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.454389:0:24208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.454409:0:24208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.454417:0:24208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791132.454433:0:24208:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787791132.454754:0:24208:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1787791132.454850:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22727:x1874634268200832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 133838us (135403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791132.454859:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787791132.454912:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3a570c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22727:1874634268200832:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787791132.454927:0:22727:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1787791132.454972:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22727:1874634268202368:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787791132.455005:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791132.455035:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c88d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787791132.455050:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202368 00000100:00100000:0.0:1787791132.455056:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202368 00000100:00100000:0.0:1787791132.455095:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787791132.455104:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22727:x1874634268202368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787791132.455137:0:24208:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1787791132.456685:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22727:x1874634268202368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1579us (1675us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787791132.456697:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787791132.456777:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22727:1874634268202368:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787791132.456790:0:22727:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:2.0:1787791132.456881:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=681s v=(0 0) 00010000:00010000:2.0:1787791132.456887:0:24207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787791132.456895:0:24207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.456923:0:24207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.456935:0:24207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.456942:0:24207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791132.456967:0:24207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1787791132.457024:0:24207:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1787791132.457065:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4588780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22725:x1874634268201088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 136052us (136551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791132.457073:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787791132.457104:0:22725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22725:1874634268201088:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787791132.457113:0:22725:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1787791132.457145:0:22725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22725:1874634268202496:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787791132.457174:0:22725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791132.457191:0:22725:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc36ee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791132.457206:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202496 00000100:00100000:2.0:1787791132.457211:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202496 00000100:00100000:2.0:1787791132.457238:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787791132.457245:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22725:x1874634268202496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787791132.457270:0:24207:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1787791132.458762:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787791132.458772:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458784:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.458790:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458801:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458821:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458828:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c957c7f/0xcf9477fddcf1f8b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458850:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787791132.458854:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458868:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2a00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791132.458871:0:22688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458878:0:22688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458888:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458895:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ddb16f2/0xcf9477fddcf1f8b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791132.458907:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.458909:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791132.458910:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787791132.459621:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787791132.465645:0:24202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1787791132.465695:0:24202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787791132.465948:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3767840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22725:x1874634268202496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8698us (8768us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1787791132.465960:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787791132.466037:0:22725:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787791132.466045:0:22725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22725:1874634268202496:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787791132.466061:0:22725:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1787791132.563037:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791133.005906:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268202624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791133.005997:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791133.006095:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202624 00000100:00100000:0.0:1787791133.006104:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202624 00000100:00100000:0.0:1787791133.006170:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787791133.006179:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268202624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787791133.006228:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787791133.006287:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268202624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791133.006294:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787791133.006630:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268202624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787791133.007011:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268202752:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791133.007049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791133.007147:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202752 00000100:00100000:0.0:1787791133.007151:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202752 00000100:00100000:0.0:1787791133.007199:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787791133.007207:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268202752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787791133.007244:0:22705:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791133.007599:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268202752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 392us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791133.007607:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787791133.007665:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268202752:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787791133.580076:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791134.603604:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787791134.802793:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787791135.627931:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787791136.652691:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787791137.108456:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787791137.108482:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268202880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787791137.108625:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791137.108724:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268202880 00000100:00100000:3.0:1787791137.108731:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268202880 00000100:00100000:3.0:1787791137.108793:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787791137.108814:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268202880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787791137.108846:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787791137.108891:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268202880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791137.108899:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787791137.108920:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791137.108971:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268202880:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787791137.611782:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268203008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791137.611859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.615731:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268203264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791137.615806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.615893:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203008 00000100:00100000:0.0:1787791137.615901:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203008 00000100:00100000:0.0:1787791137.615942:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203264 00000100:00100000:0.0:1787791137.615945:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203264 00000100:00100000:0.0:1787791137.615963:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787791137.615972:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268203008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787791137.616002:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787791137.618605:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268203136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787791137.618682:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787791137.621405:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787791137.621588:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268203648:0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.621648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791137.621679:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268204160:0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.621723:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791137.621748:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787791137.621753:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268203520:0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.621848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791137.621876:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268204032:0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.621899:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791137.621930:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203648 00000100:00100000:2.0:1787791137.621936:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203648 00000100:00100000:2.0:1787791137.621997:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204160 00000100:00100000:2.0:1787791137.622000:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204160 00000100:00100000:2.0:1787791137.622028:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204032 00000100:00100000:2.0:1787791137.622031:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204032 00000100:00100000:2.0:1787791137.622048:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787791137.622057:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268203648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.622119:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268203648:12345-0@lo:400:kworker.0 Request processed in 62us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791137.622126:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787791137.622145:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787791137.622152:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268204160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.622181:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874634268204160:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791137.622382:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787791137.622396:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787791137.622402:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268204032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.622432:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268204032:12345-0@lo:400:kworker.0 Request processed in 30us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791137.622438:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787791137.622462:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203520 00000100:00100000:2.0:1787791137.622465:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203520 00000100:00100000:2.0:1787791137.622491:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787791137.622497:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268203520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791137.622528:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268203520:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791137.622534:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787791137.622568:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787791137.622571:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787791137.622599:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3766940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268203520:0@lo:400:kworker.0 00010000:00080000:2.0:1787791137.622613:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f4b40 x1874634268204032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791137.622636:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268204032:0@lo:400:kworker.0 00010000:00080000:2.0:1787791137.622647:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc3765a40 x1874634268203648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791137.622655:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3765a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268203648:0@lo:400:kworker.0 00010000:00080000:2.0:1787791137.622665:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f43c0 x1874634268204160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787791137.622672:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1874634268204160:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623324:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268203008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7349us (11461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.623335:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787791137.623364:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268203392:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623403:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.623463:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268203904:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.623504:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268204416:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623528:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.623560:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787791137.623577:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268203776:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623601:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.623618:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268204288:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791137.623666:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203776 00000100:00100000:0.0:1787791137.623671:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203776 00000100:00100000:0.0:1787791137.623699:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787791137.623722:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268203776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623762:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268203776:12345-0@lo:400:kworker.0 Request processed in 57us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.623778:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787791137.623798:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203392 00000100:00100000:0.0:1787791137.623802:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203392 00000100:00100000:0.0:1787791137.623842:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787791137.623849:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3639:x1874634268203392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.623879:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3639:x1874634268203392:12345-0@lo:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.623886:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787791137.623910:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203904 00000100:00100000:0.0:1787791137.623914:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203904 00000100:00100000:0.0:1787791137.623935:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204416 00000100:00100000:0.0:1787791137.623937:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204416 00000100:00100000:0.0:1787791137.623960:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204288 00000100:00100000:0.0:1787791137.623963:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204288 00000100:00100000:0.0:1787791137.623976:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787791137.623982:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268203904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.624522:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874634268203904:12345-0@lo:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.624532:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787791137.624561:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787791137.624569:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268204416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.624620:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874634268204416:12345-0@lo:400:kworker.0 Request processed in 52us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.624627:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787791137.624638:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787791137.624644:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.624680:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268204288:12345-0@lo:400:kworker.0 Request processed in 36us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.624686:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787791137.624740:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787791137.624745:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787791137.624775:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268203776:0@lo:400:kworker.0 00010000:00080000:0.0:1787791137.624788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f6d00 x1874634268204288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791137.624798:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268204288:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.624808:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3764f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268203392:0@lo:400:kworker.0 00010000:00080000:0.0:1787791137.624817:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f70c0 x1874634268203904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791137.624826:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874634268203904:0@lo:400:kworker.0 00010000:00080000:0.0:1787791137.624836:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f61c0 x1874634268204416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791137.624844:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1874634268204416:0@lo:400:kworker.0 00000100:00100000:0.0:1787791137.624881:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268203136 00000100:00100000:0.0:1787791137.624886:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268203136 00000100:00080000:0.0:1787791137.624906:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787791137.624924:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791137.624931:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268203264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787791137.624950:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791137.624987:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268203264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (9182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.624998:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787791137.625033:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268203264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791137.625053:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787791137.625060:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268203136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787791137.625070:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787791137.625102:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268203136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (6421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791137.625108:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787791137.625135:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268203136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787791137.630312:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdcbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268203008:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1787791137.675725:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787791137.916413:0:25380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787791138.123873:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268204544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791138.123978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791138.128201:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787791138.128225:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268204672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791138.128300:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791138.128383:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204544 00000100:00100000:2.0:1787791138.128391:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204544 00000100:00100000:2.0:1787791138.128432:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204672 00000100:00100000:2.0:1787791138.128435:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204672 00000100:00100000:2.0:1787791138.128452:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787791138.128471:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268204544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787791138.128508:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787791138.128575:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268204544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (4597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791138.128584:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787791138.128602:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787791138.128609:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268204672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787791138.128626:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787791138.128664:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268204672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791138.128670:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787791138.128951:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268204672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791138.128969:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc4589e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268204544:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1787791138.135131:0:25023:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:2.0:1787791138.707844:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787791138.881020:0:25432:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787791138.881308:0:25432:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1787791139.148263:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787791139.723882:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787791139.820920:0:25482:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787791139.821371:0:25482:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787791140.127059:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.127228:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250270976 00000100:00100000:3.0:1787791140.127239:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250270976 00000100:00100000:3.0:1787791140.127290:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:3.0:1787791140.127299:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2399:x1874634250270976:12345-192.168.202.22@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787791140.127329:0:22695:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b4f3854a-b6f5-45ea-9618-5bb807c84384@192.168.202.22@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:3.0:1787791140.127360:0:22695:0:(genops.c:1385:class_connect()) connect: client b4f3854a-b6f5-45ea-9618-5bb807c84384, cookie 0xcf9477fddcf1f8c0 00000100:00080000:3.0:1787791140.127606:0:22695:0:(import.c:65:import_set_state_nolock()) ffff9170f7710800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787791140.127690:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+5:2399:x1874634250270976:12345-192.168.202.22@tcp:250:mount.lustre.0 Request processed in 390us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791140.127767:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:0.0:1787791140.144176:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.144572:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271104 00000100:00100000:3.0:1787791140.144584:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271104 00000100:00100000:3.0:1787791140.144650:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:3.0:1787791140.144672:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+5:18052:x1874634250271104:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787791140.144691:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791140.144750:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f8c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d92722411d expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.144785:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722411d expref: 6 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.144796:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4538c00/0xcf9477fddcf1f8c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722411d expref: 6 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.144805:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538c00, rc 0) 00000100:00100000:3.0:1787791140.144870:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+6:18052:x1874634250271104:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 210us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791140.144877:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:2.0:1787791140.148571:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.148698:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271232 00000100:00100000:0.0:1787791140.148846:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271232 00000100:00100000:0.0:1787791140.148906:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:0.0:1787791140.148917:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+6:18052:x1874634250271232:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787791140.149051:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+6:18052:x1874634250271232:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 135us (490us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787791140.149058:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:2.0:1787791140.151776:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.151895:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271360 00000100:00100000:0.0:1787791140.151906:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271360 00000100:00100000:0.0:1787791140.152011:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:0.0:1787791140.152042:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+6:18052:x1874634250271360:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787791140.152063:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791140.152082:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1f8ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224124 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.152112:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1f8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224124 expref: 7 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.152123:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fbd9fe00/0xcf9477fddcf1f8ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224124 expref: 7 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.152133:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fe00, rc 0) 00000100:00100000:0.0:1787791140.152192:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+7:18052:x1874634250271360:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 155us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.152201:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:2.0:1787791140.155378:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.155493:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271488 00000100:00100000:3.0:1787791140.155503:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271488 00000100:00100000:3.0:1787791140.155584:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:3.0:1787791140.155594:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+7:18052:x1874634250271488:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787791140.155776:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18052:x1874634250271488:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 183us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791140.155784:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:2.0:1787791140.165423:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.165632:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271616 00000100:00100000:0.0:1787791140.165642:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271616 00000100:00100000:0.0:1787791140.165742:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:0.0:1787791140.165752:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18052:x1874634250271616:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787791140.165912:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18052:x1874634250271616:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 160us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.165921:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:2.0:1787791140.168958:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.169063:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271744 00000100:00100000:1.0:1787791140.169075:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271744 00000100:00100000:1.0:1787791140.169139:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:1.0:1787791140.169149:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250271744:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787791140.169317:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250271744:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 168us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.169325:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:2.0:1787791140.213986:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.216384:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250271872 00000100:00100000:3.0:1787791140.216399:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250271872 00000100:00100000:3.0:1787791140.216468:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:3.0:1787791140.216477:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250271872:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787791140.217021:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250271872:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 541us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791140.217031:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:2.0:1787791140.229379:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.229988:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272000 00000100:00100000:0.0:1787791140.230005:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272000 00000100:00100000:0.0:1787791140.230087:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:0.0:1787791140.230099:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250272000:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787791140.230277:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18070:x1874634250272000:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 179us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.230292:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:0.0:1787791140.248167:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791140.248280:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272128 00000100:00100000:2.0:1787791140.248296:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272128 00000100:00100000:2.0:1787791140.248374:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:2.0:1787791140.248385:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+8:18052:x1874634250272128:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787791140.248403:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791140.248421:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f8d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224155 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791140.248452:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224155 expref: 9 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791140.248463:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3a00/0xcf9477fddcf1f8d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224155 expref: 9 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791140.248473:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3a00, rc 0) 00000100:00100000:2.0:1787791140.248565:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+9:18052:x1874634250272128:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 181us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791140.248572:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:2.0:1787791140.251430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.255755:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272256 00000100:00100000:1.0:1787791140.255773:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272256 00000100:00100000:1.0:1787791140.256234:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:1.0:1787791140.256247:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+9:18052:x1874634250272256:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787791140.256278:0:22693:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787791140.256309:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787791140.256314:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787791140.256317:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787791140.256320:0:22693:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787791140.256323:0:22693:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787791140.263545:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+9:18052:x1874634250272256:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 7288us (12112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.263564:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:0.0:1787791140.282296:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.282753:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272384 00000100:00100000:3.0:1787791140.282764:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272384 00000100:00100000:3.0:1787791140.282826:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:3.0:1787791140.282843:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+9:18052:x1874634250272384:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787791140.282861:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791140.282878:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d92722415c expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.283017:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 10 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.283031:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 10 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791140.283106:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539200, rc 0) 00000100:00100000:3.0:1787791140.283967:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18052:x1874634250272384:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 1128us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791140.283978:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:2.0:1787791140.291501:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.291629:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272512 00000100:00100000:1.0:1787791140.291638:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272512 00000100:00100000:1.0:1787791140.291731:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:1.0:1787791140.291743:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18052:x1874634250272512:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787791140.291951:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18052:x1874634250272512:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 209us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.291960:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:0.0:1787791140.294168:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.294356:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272640 00000100:00100000:3.0:1787791140.294367:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272640 00000100:00100000:3.0:1787791140.294425:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:3.0:1787791140.294436:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18052:x1874634250272640:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787791140.294595:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18052:x1874634250272640:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 161us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791140.294618:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:0.0:1787791140.300892:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791140.301461:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272768 00000100:00100000:2.0:1787791140.301473:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272768 00000100:00100000:2.0:1787791140.301539:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:2.0:1787791140.301550:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18076:x1874634250272768:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787791140.301772:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18076:x1874634250272768:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 224us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791140.301780:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:2.0:1787791140.314931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.315019:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250272896 00000100:00100000:1.0:1787791140.315030:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250272896 00000100:00100000:1.0:1787791140.315084:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:1.0:1787791140.315094:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18076:x1874634250272896:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787791140.315258:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18076:x1874634250272896:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 164us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.315266:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:1.0:1787791140.349825:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.349933:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791140.350234:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273024 00000100:00100000:2.0:1787791140.350244:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273024 00000100:00100000:2.0:1787791140.350293:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273280 00000100:00100000:2.0:1787791140.350297:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273280 00000100:00100000:2.0:1787791140.350316:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787791140.350324:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2399:x1874634250273024:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787791140.350355:0:22700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bd3b2ccd-1632-4ec7-bd48-84a904f4451a@192.168.202.22@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:2.0:1787791140.350411:0:22700:0:(genops.c:1385:class_connect()) connect: client bd3b2ccd-1632-4ec7-bd48-84a904f4451a, cookie 0xcf9477fddcf1f8e3 00000100:00100000:1.0:1787791140.350552:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787791140.350558:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2399:x1874634250273280:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787791140.350575:0:22702:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bd3b2ccd-1632-4ec7-bd48-84a904f4451a@192.168.202.22@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:1.0:1787791140.350628:0:22702:0:(genops.c:1385:class_connect()) connect: client bd3b2ccd-1632-4ec7-bd48-84a904f4451a, cookie 0xcf9477fddcf1f8ea 00000004:00100000:1.0:1787791140.350643:0:22702:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787791140.350879:0:22702:0:(import.c:65:import_set_state_nolock()) ffff916fc1c12000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787791140.350956:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2399:x1874634250273280:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 395us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.350964:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000004:00100000:2.0:1787791140.351475:0:22700:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787791140.352067:0:22700:0:(import.c:65:import_set_state_nolock()) ffff916fc1c16000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787791140.352219:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2399:x1874634250273024:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 1893us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.352249:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787791140.358460:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.358567:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273536 00000100:00100000:0.0:1787791140.358580:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273536 00000100:00080000:2.0:1787791140.358666:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787791140.358674:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:0.0:1787791140.358685:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250273536:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787791140.358767:0:24774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787791140.358864:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250273536:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 181us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.358871:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:2.0:1787791140.362361:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.362456:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273152 00000100:00100000:1.0:1787791140.362465:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273152 00000100:00100000:1.0:1787791140.362535:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787791140.362545:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:0:x1874634250273152:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787791140.362576:0:22700:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787791140.362665:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:0:x1874634250273152:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.362674:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:2.0:1787791140.366413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.366522:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273408 00000100:00100000:0.0:1787791140.366532:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273408 00000100:00100000:0.0:1787791140.366615:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:0.0:1787791140.366626:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:0:x1874634250273408:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787791140.366669:0:24230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791140.366811:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:0:x1874634250273408:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.366819:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:2.0:1787791140.366983:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787791140.375690:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.377454:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273664 00000100:00100000:1.0:1787791140.377472:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273664 00000100:00100000:1.0:1787791140.377562:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787791140.377575:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250273664:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787791140.377688:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250273664:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 115us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791140.377697:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787791140.380838:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.384048:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791140.384121:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.384588:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273792 00000100:00100000:0.0:1787791140.384599:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273792 00000100:00100000:0.0:1787791140.384647:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250273920 00000100:00100000:0.0:1787791140.384650:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250273920 00000100:00100000:0.0:1787791140.384673:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787791140.384696:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250273792:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787791140.384758:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bd3b2ccd-1632-4ec7-bd48-84a904f4451a@192.168.202.22@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1787791140.384792:0:24827:0:(genops.c:1385:class_connect()) connect: client bd3b2ccd-1632-4ec7-bd48-84a904f4451a, cookie 0xcf9477fddcf1f8f1 00002000:00100000:0.0:1787791140.384804:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd3b2ccd-1632-4ec7-bd48-84a904f4451a/ffff916fc44c2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787791140.384823:0:24827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787791140.384998:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787791140.385030:0:24827:0:(import.c:65:import_set_state_nolock()) ffff916fc44c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791140.385096:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2399:x1874634250273792:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 400us (4271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.385105:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787791140.385122:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:0.0:1787791140.385127:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250273920:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787791140.385144:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bd3b2ccd-1632-4ec7-bd48-84a904f4451a@192.168.202.22@tcp t0 exp 0000000000000000 cur 689 last 0 00000020:00000080:0.0:1787791140.385159:0:24827:0:(genops.c:1385:class_connect()) connect: client bd3b2ccd-1632-4ec7-bd48-84a904f4451a, cookie 0xcf9477fddcf1f8f8 00002000:00100000:0.0:1787791140.385166:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd3b2ccd-1632-4ec7-bd48-84a904f4451a/ffff916fc44c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787791140.385177:0:24827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787791140.385287:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787791140.385304:0:24827:0:(import.c:65:import_set_state_nolock()) ffff916fc44c7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791140.385329:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2399:x1874634250273920:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 200us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.385336:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787791140.385591:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274048 00000100:00100000:2.0:1787791140.385597:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274048 00000100:00100000:2.0:1787791140.385679:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:2.0:1787791140.385688:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250274048:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787791140.385782:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250274048:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 96us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791140.385789:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787791140.399640:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791140.403087:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274176 00000100:00100000:1.0:1787791140.403101:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274176 00000100:00100000:1.0:1787791140.403223:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787791140.403233:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250274176:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787791140.407479:0:22703:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4130us 00000004:00200000:2.0:1787791140.437424:0:22703:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787791140.437590:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18052:x1874634250274176:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 34352us (38884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791140.437604:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:3.0:1787791140.650812:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791140.650905:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274304 00000100:00100000:0.0:1787791140.650917:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274304 00000100:00100000:0.0:1787791140.650990:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:0.0:1787791140.651017:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18099:x1874634250274304:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:0.0:1787791140.651040:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791140.651063:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f8ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722418d expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651129:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651141:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651154:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791140.651198:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787791140.651201:0:22701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791140.651240:0:22701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651262:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f8ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722418d expref: 8 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651275:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722418d expref: 7 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791140.651281:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:0.0:1787791140.651283:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787791140.651286:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f400, rc 0) 00000100:00100000:0.0:1787791140.651338:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdcb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:18099:x1874634250274304:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 325us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791140.651350:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00010000:00010000:2.0:1787791140.750827:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787791141.770943:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791142.219066:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268204800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791142.219177:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791142.219251:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204800 00000100:00100000:3.0:1787791142.219261:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204800 00000100:00100000:3.0:1787791142.219336:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787791142.219342:0:24209:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1787791142.219349:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268204800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787791142.219355:0:24209:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1787791142.219382:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787791142.219433:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268204800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791142.219441:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787791142.219849:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787791142.219882:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc458a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268204800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787791142.683652:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.683760:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274432 00000100:00100000:1.0:1787791142.683770:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274432 00000100:00100000:1.0:1787791142.683851:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:1.0:1787791142.683861:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:18151:x1874634250274432:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:1.0:1787791142.683900:0:24774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787791142.683996:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc4589e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:18151:x1874634250274432:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 137us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.684006:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00080000:2.0:1787791142.684267:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787791142.691629:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.691733:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274560 00000100:00100000:0.0:1787791142.691742:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274560 00000100:00100000:0.0:1787791142.691806:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:0.0:1787791142.691812:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274560:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:0.0:1787791142.691871:0:22700:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791142.691965:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc458a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274560:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 152us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.691971:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00080000:2.0:1787791142.692098:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787791142.700000:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.701160:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274688 00000100:00100000:1.0:1787791142.701172:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274688 00000100:00100000:1.0:1787791142.701297:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787791142.701305:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274688:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:1.0:1787791142.701332:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791142.701457:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a570c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274688:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 151us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.701465:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00080000:2.0:1787791142.702255:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791142.704946:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.705117:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274816 00000100:00100000:1.0:1787791142.705127:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274816 00000100:00100000:1.0:1787791142.705220:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787791142.705232:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274816:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:1.0:1787791142.705265:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787791142.705363:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3a54b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18151:x1874634250274816:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 133us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.705371:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:2.0:1787791142.706136:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791142.730945:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791142.730971:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268204928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787791142.731053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791142.731140:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791142.731152:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268205184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787791142.731312:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268204928 00000100:00100000:3.0:1787791142.731323:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268204928 00000100:00100000:3.0:1787791142.731405:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787791142.731414:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268204928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787791142.731438:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00080000:2.0:1787791142.731901:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787791142.731918:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268205440:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735160:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735262:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268205696:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735332:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268206208:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735358:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735386:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787791142.735393:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268205568:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735453:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268206080:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735473:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735489:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268206592:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.735585:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205568 00000100:00100000:0.0:1787791142.735593:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205568 00000100:00100000:0.0:1787791142.735669:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791142.735679:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268205568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.735751:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268205568:12345-0@lo:400:kworker.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.735757:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787791142.735783:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205696 00000100:00100000:0.0:1787791142.735787:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205696 00000100:00100000:0.0:1787791142.735811:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206208 00000100:00100000:0.0:1787791142.735814:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206208 00000100:00100000:0.0:1787791142.735829:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206080 00000100:00100000:0.0:1787791142.736006:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206080 00000100:00100000:0.0:1787791142.736026:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206592 00000100:00100000:0.0:1787791142.736028:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206592 00000100:00100000:0.0:1787791142.736042:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787791142.736048:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268205696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736080:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874634268205696:12345-0@lo:400:kworker.0 Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.736085:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787791142.736095:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787791142.736101:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268206208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736122:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268206208:12345-0@lo:400:kworker.0 Request processed in 23us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.736127:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787791142.736137:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787791142.736142:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268206080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736175:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268206080:12345-0@lo:400:kworker.0 Request processed in 32us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.736181:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787791142.736192:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787791142.736198:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268206592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736222:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268206592:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.736226:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787791142.736242:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787791142.736246:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787791142.736248:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791142.736271:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268205312:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736307:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.736339:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268205824:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.736390:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268206336:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736415:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791142.736451:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205824 00000100:00100000:0.0:1787791142.736456:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205824 00000100:00100000:0.0:1787791142.736488:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787791142.736507:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268205824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.736542:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268205824:12345-0@lo:400:kworker.0 Request processed in 38us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.736547:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787791142.736564:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206336 00000100:00100000:0.0:1787791142.736567:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206336 00000100:00100000:0.0:1787791142.736598:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787791142.736603:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268206336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737253:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268206336:12345-0@lo:400:kworker.0 Request processed in 647us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.737261:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787791142.737283:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787791142.737316:0:3641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787791142.737348:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268205568:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737367:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268206080:0@lo:400:kworker.0 00010000:00080000:0.0:1787791142.737379:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37661c0 x1874634268206592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791142.737389:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268206592:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737399:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874634268205696:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737412:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268206208:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737461:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268205824:0@lo:400:kworker.0 00010000:00080000:0.0:1787791142.737472:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f6d00 x1874634268206336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791142.737482:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268206336:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737513:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205312 00000100:00100000:0.0:1787791142.737517:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205312 00000100:00100000:0.0:1787791142.737555:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787791142.737562:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3638:x1874634268205312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737608:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3638:x1874634268205312:12345-0@lo:400:kworker.0 Request processed in 47us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.737624:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787791142.737681:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268205312:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.737731:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205184 00000100:00100000:0.0:1787791142.737735:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205184 00000100:00080000:0.0:1787791142.737752:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791142.737775:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787791142.737781:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268205184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787791142.737796:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791142.737840:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f45680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268205184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (2686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.739150:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787791142.739343:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268205184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787791142.741426:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f46580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268204928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10003us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791142.741441:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791142.741873:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791142.741983:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205056 00000100:00100000:3.0:1787791142.741991:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205056 00000100:00100000:3.0:1787791142.742041:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787791142.742052:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268205056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787791142.742076:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787791142.742131:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268205056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791142.742137:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787791142.742280:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791142.742847:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f47840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268204928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787791142.746244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791142.746356:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268205952:0@lo:400:kworker.0 00000100:00100000:2.0:1787791142.746412:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791142.746443:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268206464:0@lo:400:kworker.0 00000100:00100000:2.0:1787791142.746472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791142.747755:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205952 00000100:00100000:1.0:1787791142.747767:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205952 00000100:00100000:1.0:1787791142.747835:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787791142.747845:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791142.747919:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3765a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268205952:12345-0@lo:400:kworker.0 Request processed in 75us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.747927:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787791142.748012:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206464 00000100:00100000:3.0:1787791142.748016:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206464 00000100:00100000:3.0:1787791142.748070:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787791142.748078:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268206464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791142.748116:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3766940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874634268206464:12345-0@lo:400:kworker.0 Request processed in 40us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791142.748122:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1787791142.748184:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787791142.753303:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268205952:0@lo:400:kworker.0 00000100:00100000:2.0:1787791142.753326:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1874634268206464:0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.755059:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268205440 00000100:00100000:0.0:1787791142.755075:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268205440 00000100:00100000:0.0:1787791142.755154:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787791142.755165:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268205440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791142.755269:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3764f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268205440:12345-0@lo:400:kworker.0 Request processed in 105us (9034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.755277:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787791142.755599:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268205440:0@lo:400:kworker.0 00010000:00010000:2.0:1787791142.795083:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791142.887947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791142.888106:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250274944 00000100:00100000:2.0:1787791142.888129:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250274944 00000100:00100000:2.0:1787791142.888196:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:2.0:1787791142.888207:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+10:18184:x1874634250274944:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787791142.888224:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791142.888243:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2000/0xcf9477fddcf1f90d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224194 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791142.888272:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2000/0xcf9477fddcf1f90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224194 expref: 11 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791142.888283:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2000/0xcf9477fddcf1f90d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224194 expref: 11 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791142.888293:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2000, rc 0) 00000100:00100000:2.0:1787791142.888358:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250274944:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 152us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791142.888366:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:0.0:1787791142.895826:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.902659:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275072 00000100:00100000:1.0:1787791142.902674:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275072 00000100:00100000:1.0:1787791142.902825:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:1.0:1787791142.902836:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250275072:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787791142.903274:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250275072:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 439us (7469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.903282:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:3.0:1787791142.910303:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.910438:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275200 00000100:00100000:0.0:1787791142.910454:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275200 00000100:00100000:0.0:1787791142.910546:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:0.0:1787791142.910583:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250275200:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787791142.910817:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250275200:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 239us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.910826:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:0.0:1787791142.919448:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.919868:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275328 00000100:00100000:1.0:1787791142.919884:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275328 00000100:00100000:1.0:1787791142.919957:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:1.0:1787791142.919968:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275328:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787791142.920150:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275328:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 183us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.920349:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:3.0:1787791142.939460:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791142.939671:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275456 00000100:00100000:2.0:1787791142.939685:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275456 00000100:00100000:2.0:1787791142.939804:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:2.0:1787791142.939817:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275456:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787791142.940033:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275456:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 218us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791142.940054:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:3.0:1787791142.947063:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.947595:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275584 00000100:00100000:0.0:1787791142.947610:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275584 00000100:00100000:0.0:1787791142.947700:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787791142.947756:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275584:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787791142.947959:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18190:x1874634250275584:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 205us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.947967:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787791142.950735:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.950819:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275712 00000100:00100000:1.0:1787791142.950835:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275712 00000100:00100000:1.0:1787791142.950913:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:1.0:1787791142.950923:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18184:x1874634250275712:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787791142.950949:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791142.950964:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995800/0xcf9477fddcf1f914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d9272241c5 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.950999:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995800/0xcf9477fddcf1f914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241c5 expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.951007:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995800/0xcf9477fddcf1f914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241c5 expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.951015:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995800, rc 0) 00000100:00100000:1.0:1787791142.951083:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18184:x1874634250275712:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 162us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.951090:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:3.0:1787791142.959290:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791142.959437:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275840 00000100:00100000:2.0:1787791142.959450:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275840 00000100:00100000:2.0:1787791142.959750:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:2.0:1787791142.959767:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18184:x1874634250275840:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787791142.959806:0:22694:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787791142.959843:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787791142.959848:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787791142.959851:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787791142.959855:0:22694:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787791142.959857:0:22694:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1787791142.962348:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18184:x1874634250275840:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 2570us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791142.962368:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:3.0:1787791142.972773:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791142.973785:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250275968 00000100:00100000:1.0:1787791142.973801:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250275968 00000100:00100000:1.0:1787791142.974032:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:1.0:1787791142.974048:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18184:x1874634250275968:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787791142.974074:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791142.974100:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d9272241cc expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.974208:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.974223:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 13 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791142.974260:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:1.0:1787791142.974354:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18184:x1874634250275968:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 310us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791142.974362:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:3.0:1787791142.976677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.977314:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276096 00000100:00100000:0.0:1787791142.977328:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276096 00000100:00100000:0.0:1787791142.977392:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:0.0:1787791142.977403:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18184:x1874634250276096:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787791142.977642:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f3da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18184:x1874634250276096:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 233us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.977651:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:3.0:1787791142.979906:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.980345:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276224 00000100:00100000:0.0:1787791142.980359:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276224 00000100:00100000:0.0:1787791142.980421:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:0.0:1787791142.980433:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18184:x1874634250276224:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787791142.980669:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18184:x1874634250276224:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 237us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.980686:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:3.0:1787791142.984405:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.984903:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276352 00000100:00100000:0.0:1787791142.984917:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276352 00000100:00100000:0.0:1787791142.984999:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:0.0:1787791142.985011:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18193:x1874634250276352:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787791142.985237:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18193:x1874634250276352:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 226us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.985246:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:1.0:1787791142.990842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791142.991129:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276480 00000100:00100000:2.0:1787791142.991144:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276480 00000100:00100000:2.0:1787791142.991224:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 144 00000100:00100000:2.0:1787791142.991236:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18193:x1874634250276480:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787791142.991445:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18193:x1874634250276480:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 210us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791142.991454:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 144 00000100:00100000:3.0:1787791142.998514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791142.998921:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791142.999035:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276608 00000100:00100000:0.0:1787791142.999049:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276608 00000100:00100000:0.0:1787791142.999107:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276864 00000100:00100000:0.0:1787791142.999111:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276864 00000100:00100000:0.0:1787791142.999148:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787791142.999159:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874634250276608:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787791142.999199:0:22701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ce68e33a-1a74-43fd-9813-d959cabf93bb@192.168.202.22@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1787791142.999249:0:22701:0:(genops.c:1385:class_connect()) connect: client ce68e33a-1a74-43fd-9813-d959cabf93bb, cookie 0xcf9477fddcf1f922 00000004:00100000:0.0:1787791142.999282:0:22701:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787791142.999428:0:22701:0:(import.c:65:import_set_state_nolock()) ffff9170f77d3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791142.999525:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170c9968b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2399:x1874634250276608:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 366us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.999534:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787791142.999556:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:0.0:1787791142.999561:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2399:x1874634250276864:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787791142.999577:0:22701:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ce68e33a-1a74-43fd-9813-d959cabf93bb@192.168.202.22@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1787791142.999609:0:22701:0:(genops.c:1385:class_connect()) connect: client ce68e33a-1a74-43fd-9813-d959cabf93bb, cookie 0xcf9477fddcf1f929 00000004:00100000:0.0:1787791142.999624:0:22701:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787791142.999688:0:22701:0:(import.c:65:import_set_state_nolock()) ffff9170f77d4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791142.999743:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2399:x1874634250276864:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 181us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791142.999750:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787791143.008784:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791143.008826:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791143.008873:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791143.009071:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277120 00000100:00100000:2.0:1787791143.009084:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277120 00000100:00100000:2.0:1787791143.009183:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276992 00000100:00100000:2.0:1787791143.009186:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276992 00000100:00100000:2.0:1787791143.009210:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250276736 00000100:00100000:2.0:1787791143.009213:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250276736 00000100:00100000:2.0:1787791143.009255:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787791143.009264:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+7:18184:x1874634250277120:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787791143.009310:0:24774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787791143.009398:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+7:18184:x1874634250277120:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 133us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791143.009406:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787791143.009429:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787791143.009435:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:0:x1874634250276992:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787791143.009448:0:24774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787791143.009480:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:0:x1874634250276992:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 45us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791143.009487:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787791143.009533:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:2.0:1787791143.009541:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:0:x1874634250276736:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787791143.009553:0:24774:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787791143.009576:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:0:x1874634250276736:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 36us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791143.009583:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00080000:3.0:1787791143.010230:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787791143.010237:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787791143.012085:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791143.012191:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277248 00000100:00100000:2.0:1787791143.012203:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277248 00000100:00100000:2.0:1787791143.012266:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:2.0:1787791143.012277:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277248:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787791143.012371:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277248:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791143.012397:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787791143.017995:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791143.018054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791143.018095:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791143.018423:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277632 00000100:00100000:0.0:1787791143.018438:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277632 00000100:00100000:0.0:1787791143.018537:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787791143.018548:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277632:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787791143.018667:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277632:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 120us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791143.018676:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787791143.018864:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277376 00000100:00100000:2.0:1787791143.018869:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277376 00000100:00100000:2.0:1787791143.018899:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277504 00000100:00100000:2.0:1787791143.018902:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277504 00000100:00100000:2.0:1787791143.018924:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787791143.018930:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2399:x1874634250277376:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787791143.018963:0:25087:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ce68e33a-1a74-43fd-9813-d959cabf93bb@192.168.202.22@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:2.0:1787791143.019004:0:25087:0:(genops.c:1385:class_connect()) connect: client ce68e33a-1a74-43fd-9813-d959cabf93bb, cookie 0xcf9477fddcf1f930 00002000:00100000:2.0:1787791143.019021:0:25087:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ce68e33a-1a74-43fd-9813-d959cabf93bb/ffff9170c76b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787791143.019037:0:25087:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787791143.019327:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:0.0:1787791143.019333:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2399:x1874634250277504:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787791143.019354:0:24827:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ce68e33a-1a74-43fd-9813-d959cabf93bb@192.168.202.22@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1787791143.019374:0:24827:0:(genops.c:1385:class_connect()) connect: client ce68e33a-1a74-43fd-9813-d959cabf93bb, cookie 0xcf9477fddcf1f937 00002000:00100000:0.0:1787791143.019380:0:24827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ce68e33a-1a74-43fd-9813-d959cabf93bb/ffff9170f77d2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113932 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787791143.019387:0:24827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787791143.019428:0:24827:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787791143.019466:0:24827:0:(import.c:65:import_set_state_nolock()) ffff9170f77d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787791143.019523:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2399:x1874634250277504:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 188us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791143.019530:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00002000:00080000:2.0:1787791143.019612:0:25087:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787791143.021421:0:25087:0:(import.c:65:import_set_state_nolock()) ffff9170c76b6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787791143.021554:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2399:x1874634250277376:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 2615us (3491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791143.021568:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787791143.022525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791143.023312:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277760 00000100:00100000:1.0:1787791143.023327:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277760 00000100:00100000:1.0:1787791143.023408:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:1.0:1787791143.023421:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277760:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787791143.023554:0:22704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787791143.023661:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18184:x1874634250277760:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 243us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791143.023669:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:1.0:1787791143.244325:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791143.244368:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250277888 00000100:00100000:1.0:1787791143.244379:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250277888 00000100:00100000:1.0:1787791143.244454:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:1.0:1787791143.244466:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18216:x1874634250277888:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:1.0:1787791143.244505:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791143.244538:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1f93e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272241fd expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244631:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244648:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244676:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787791143.244772:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787791143.244777:0:22701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787791143.244806:0:22701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244840:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1f93e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 8 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244861:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 7 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791143.244873:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:1.0:1787791143.244876:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787791143.244881:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994200, rc 0) 00000100:00100000:2.0:1787791143.245095:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787791143.245119:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268206720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791143.245180:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791143.245517:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206720 00000100:00100000:0.0:1787791143.245523:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206720 00000100:00100000:0.0:1787791143.245563:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787791143.245571:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268206720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787791143.245603:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791143.245653:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268206720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791143.245660:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787791143.245683:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787791143.245693:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268206848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791143.245745:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791143.245772:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206848 00000100:00100000:0.0:1787791143.245775:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206848 00000100:00100000:0.0:1787791143.245792:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787791143.245798:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268206848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787791143.245840:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787791143.245877:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f47840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268206848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791143.245884:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787791143.245929:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268206848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791143.246040:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268206720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791143.248471:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+7:18216:x1874634250277888:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 486us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791143.248509:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00010000:00010000:3.0:1787791143.821261:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791144.015114:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787791144.843543:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787791145.806168:0:22680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ce68e33a-1a74-43fd-9813-d959cabf93bb 00000001:00100000:1.0:1787791145.806181:0:22680:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd3b2ccd-1632-4ec7-bd48-84a904f4451a 00000001:00100000:2.0:1787791145.806619:0:24202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ce68e33a-1a74-43fd-9813-d959cabf93bb 00000001:00100000:2.0:1787791145.806629:0:24202:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd3b2ccd-1632-4ec7-bd48-84a904f4451a 00000001:00100000:1.0:1787791145.806961:0:23434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ce68e33a-1a74-43fd-9813-d959cabf93bb 00000001:00100000:1.0:1787791145.806968:0:23434:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd3b2ccd-1632-4ec7-bd48-84a904f4451a 00000001:00100000:0.0:1787791145.807316:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ce68e33a-1a74-43fd-9813-d959cabf93bb 00000001:00100000:0.0:1787791145.807323:0:25023:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd3b2ccd-1632-4ec7-bd48-84a904f4451a 00010000:00010000:3.0:1787791145.866931:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787791146.407694:0:25581:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787791146.891450:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791147.339377:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787791147.343764:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268206976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791147.343860:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791147.348499:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268206976 00000100:00100000:3.0:1787791147.348512:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268206976 00000100:00080000:1.0:1787791147.348578:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791147.348861:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787791147.348878:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268206976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787791147.348911:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787791147.350152:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268206976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787791147.350216:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268206976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1213us (6225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791147.350228:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787791147.855562:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787791147.855587:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268207104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787791147.855658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856179:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268207616:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856239:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268208128:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856279:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268208640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787791147.856301:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856319:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787791147.856324:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268207232:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856350:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856373:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268207744:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856411:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268208256:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856429:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856471:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268207360:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856496:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856512:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268207872:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856534:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856555:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268208384:0@lo:400:kworker.0 00000100:00100000:2.0:1787791147.856561:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207872 00000100:00100000:2.0:1787791147.856568:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207872 00000100:00100000:0.0:1787791147.856575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856605:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787791147.856611:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268207488:0@lo:400:kworker.0 00000100:00100000:2.0:1787791147.856623:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787791147.856633:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268207872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856633:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791147.856648:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268208000:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791147.856677:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268207872:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791147.856684:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787791147.856692:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268208512:0@lo:400:kworker.0 00000100:00100000:2.0:1787791147.856699:0:24208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207488 00000100:00100000:2.0:1787791147.856702:0:24208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207488 00000100:00100000:0.0:1787791147.856737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791147.856745:0:24208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787791147.856751:0:24208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268207488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856770:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268207872:0@lo:400:kworker.0 00000100:00100000:2.0:1787791147.856776:0:24208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268207488:12345-0@lo:400:kworker.0 Request processed in 27us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791147.856782:0:24208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787791147.856792:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268207488:0@lo:400:kworker.0 00000100:00080000:2.0:1787791147.856797:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787791147.856801:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791147.856814:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207616 00000100:00100000:0.0:1787791147.856817:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207616 00000100:00100000:0.0:1787791147.856839:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208128 00000100:00100000:0.0:1787791147.856842:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208128 00000100:00100000:0.0:1787791147.856860:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208256 00000100:00100000:0.0:1787791147.856863:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208256 00000100:00100000:0.0:1787791147.856874:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208384 00000100:00100000:0.0:1787791147.856876:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208384 00000100:00100000:0.0:1787791147.856888:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208000 00000100:00100000:0.0:1787791147.856890:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208000 00000100:00100000:0.0:1787791147.856899:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208512 00000100:00100000:0.0:1787791147.856902:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208512 00000100:00100000:0.0:1787791147.856914:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787791147.856920:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268207616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.856954:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874634268207616:12345-0@lo:400:kworker.0 Request processed in 34us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.856959:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787791147.856974:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787791147.856980:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268208128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857006:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874634268208128:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857011:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787791147.857022:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787791147.857027:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268208256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857051:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874634268208256:12345-0@lo:400:kworker.0 Request processed in 24us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857064:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787791147.857076:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787791147.857082:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268208384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857112:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268208384:12345-0@lo:400:kworker.0 Request processed in 31us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857118:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787791147.857129:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787791147.857135:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268208000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857160:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874634268208000:12345-0@lo:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857165:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787791147.857175:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787791147.857180:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268208512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857204:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874634268208512:12345-0@lo:400:kworker.0 Request processed in 24us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857209:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787791147.857230:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207104 00000100:00100000:0.0:1787791147.857234:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207104 00000100:00100000:0.0:1787791147.857257:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208640 00000100:00100000:0.0:1787791147.857260:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208640 00000100:00100000:0.0:1787791147.857270:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787791147.857276:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268207104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787791147.857297:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791147.857328:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268207104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857342:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787791147.857354:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787791147.857359:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268208640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787791147.857369:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791147.857392:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268208640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857398:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787791147.857413:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207232 00000100:00100000:0.0:1787791147.857416:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207232 00000100:00100000:0.0:1787791147.857439:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787791147.857459:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3640:x1874634268207232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857491:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f06850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3640:x1874634268207232:12345-0@lo:400:kworker.0 Request processed in 46us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857496:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787791147.857522:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207744 00000100:00100000:0.0:1787791147.857525:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207744 00000100:00100000:0.0:1787791147.857541:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268207360 00000100:00100000:0.0:1787791147.857543:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268207360 00000100:00100000:0.0:1787791147.857554:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787791147.857560:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268207744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857588:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268207744:12345-0@lo:400:kworker.0 Request processed in 29us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857594:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787791147.857605:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787791147.857610:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268207360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857636:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268207360:12345-0@lo:400:kworker.0 Request processed in 26us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791147.857647:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787791147.857675:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787791147.857680:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787791147.857682:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787791147.857723:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e47f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3640:1874634268207232:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857737:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268207744:0@lo:400:kworker.0 00010000:00080000:0.0:1787791147.857750:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f4780 x1874634268208256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791147.857760:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1874634268208256:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857770:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874634268207616:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857779:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1874634268208128:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857792:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268208640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787791147.857831:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874634268208000:0@lo:400:kworker.0 00010000:00080000:0.0:1787791147.857842:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc45f7840 x1874634268208512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791147.857852:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1874634268208512:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857860:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268207360:0@lo:400:kworker.0 00000100:00100000:0.0:1787791147.857869:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268208384:0@lo:400:kworker.0 00000100:00100000:2.0:1787791147.860527:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268207104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787791147.860558:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268208768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787791147.860616:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791147.860670:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208768 00000100:00100000:1.0:1787791147.860693:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208768 00000100:00100000:1.0:1787791147.860883:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787791147.860894:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268208768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787791147.860914:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787791147.860958:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874634268208768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791147.860965:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787791147.861791:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1874634268208768:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787791147.916250:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791148.363029:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268208896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787791148.363102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791148.363179:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268208896 00000100:00100000:0.0:1787791148.363185:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268208896 00000100:00100000:0.0:1787791148.363244:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787791148.363254:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268208896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787791148.363287:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787791148.363330:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1874634268208896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791148.363336:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787791148.363381:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1874634268208896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787791148.365340:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268209024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787791148.365398:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791148.365458:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209024 00000100:00100000:1.0:1787791148.365465:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209024 00000100:00100000:1.0:1787791148.365510:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787791148.365517:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268209024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787791148.365544:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787791148.365577:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268209024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791148.365582:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787791148.365631:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268209024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787791148.484208:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484249:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484279:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484298:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484321:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484349:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791148.484379:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278144 00000100:00100000:0.0:1787791148.484388:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278144 00000100:00100000:0.0:1787791148.484461:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278656 00000100:00100000:0.0:1787791148.484464:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278656 00000100:00100000:0.0:1787791148.484486:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278272 00000100:00100000:0.0:1787791148.484489:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278272 00000100:00100000:0.0:1787791148.484505:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787791148.484515:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2403:x1874634250278144:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787791148.484609:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2403:x1874634250278144:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 95us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791148.484617:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787791148.484637:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787791148.484643:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2403:x1874634250278656:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787791148.484687:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2403:x1874634250278656:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791148.484693:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787791148.484710:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787791148.484746:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278272:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787791148.484769:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e47f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278272:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 54us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791148.484775:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:0.0:1787791148.484794:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278016 00000100:00100000:0.0:1787791148.484797:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278016 00000100:00100000:0.0:1787791148.484821:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:0.0:1787791148.484828:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:2403:x1874634250278016:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787791148.484852:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e5f04c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:2403:x1874634250278016:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791148.484860:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00080000:0.0:1787791148.484889:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787791148.484893:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787791148.485119:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278400 00000100:00100000:3.0:1787791148.485123:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278400 00000100:00100000:3.0:1787791148.485170:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278912 00000100:00100000:3.0:1787791148.485174:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278912 00000100:00100000:3.0:1787791148.485204:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787791148.485211:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278400:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791148.485240:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278400:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 30us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791148.485246:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787791148.485258:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787791148.485263:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc37dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250278912:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791148.485281:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc37dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250278912:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 18us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791148.485287:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00080000:0.0:1787791148.485638:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791148.495937:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791148.495977:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791148.496001:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791148.496028:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278528 00000100:00100000:3.0:1787791148.496037:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278528 00000100:00100000:3.0:1787791148.496092:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279040 00000100:00100000:3.0:1787791148.496095:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279040 00000100:00100000:3.0:1787791148.496188:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:3.0:1787791148.496266:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278528:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791148.496353:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250278528:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 156us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791148.496360:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:3.0:1787791148.496379:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787791148.496386:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250279040:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791148.496429:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250279040:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 44us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791148.496436:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00080000:3.0:1787791148.496463:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787791148.496795:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250278784 00000100:00100000:3.0:1787791148.496800:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250278784 00000100:00100000:3.0:1787791148.496836:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787791148.496844:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250278784:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791148.496878:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170ff5d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250278784:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 35us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791148.496885:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00080000:3.0:1787791148.496900:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787791148.939058:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791149.388282:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787791149.963336:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787791150.202461:0:25728:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe351e7850 20000000:00000080:2.0:1787791150.202479:0:25728:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9170f77ed000 uarg=0000000000000000 20000000:01000000:2.0:1787791150.202594:0:25728:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787791150.202607:0:25728:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787791150.202613:0:25728:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787791150.203139:0:25729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1787791150.204340:0:25728:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787791150.221475:0:25728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787791150.221644:0:25728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221664:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221672:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221696:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221730:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221742:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 12 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221750:0:25728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221757:0:25728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221802:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221816:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.221830:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209152:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787791150.221943:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 12 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.221951:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 12 pid: 22695 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.221958:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209280:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787791150.221998:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.222006:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.222015:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209408:0@lo:104: 00000100:00100000:0.0:1787791150.222055:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791150.222097:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.222106:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 23 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.222114:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209536:0@lo:104: 00000100:00100000:0.0:1787791150.222145:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791150.222166:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 23 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.222173:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 23 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.222181:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209664:0@lo:104: 00000100:00100000:0.0:1787791150.222202:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791150.222219:0:25728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791150.222228:0:25728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 23 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.222247:0:25728:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209792:0@lo:104: 00000100:00100000:0.0:1787791150.222269:0:25728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791150.222279:0:25728:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc460c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791150.222657:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209408 00000100:00100000:1.0:1787791150.222664:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209408 00000100:00100000:1.0:1787791150.222721:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209536 00000100:00100000:1.0:1787791150.222725:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209536 00000100:00100000:1.0:1787791150.222738:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209664 00000100:00100000:1.0:1787791150.222740:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209664 00000100:00100000:1.0:1787791150.222750:0:22684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209792 00000100:00100000:1.0:1787791150.222759:0:22684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209792 00000100:00100000:1.0:1787791150.222778:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787791150.222786:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:25728:x1874634268209408:12345-0@lo:104: 00010000:00010000:1.0:1787791150.222798:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.222853:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787791150.222858:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+6:25728:x1874634268209408:12345-0@lo:104: Request processed in 74us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791150.222865:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787791150.222900:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791150.222906:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:25728:x1874634268209536:12345-0@lo:104: 00010000:00010000:1.0:1787791150.222913:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.222944:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787791150.222949:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+5:25728:x1874634268209536:12345-0@lo:104: Request processed in 44us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791150.222955:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787791150.222974:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791150.222981:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:25728:x1874634268209664:12345-0@lo:104: 00010000:00010000:1.0:1787791150.222987:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223011:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787791150.223016:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+4:25728:x1874634268209664:12345-0@lo:104: Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791150.223022:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787791150.223040:0:22684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787791150.223047:0:22684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:25728:x1874634268209792:12345-0@lo:104: 00010000:00010000:1.0:1787791150.223054:0:22684:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223079:0:22684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787791150.223084:0:22684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+3:25728:x1874634268209792:12345-0@lo:104: Request processed in 38us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791150.223089:0:22684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787791150.223109:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787791150.223115:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223121:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa400 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791150.223131:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223140:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791150.223148:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791150.223153:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787791150.223189:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223195:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791150.223213:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223229:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa400/0xcf9477fddcf1f689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f690 expref: -99 pid: 25022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223241:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787791150.223244:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223248:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d4200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791150.223251:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223258:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791150.223264:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791150.223269:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787791150.223282:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223287:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791150.223292:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223298:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d4200/0xcf9477fddcf1f5ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5f6 expref: -99 pid: 24201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223305:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787791150.223313:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223318:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc26fa200 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791150.223320:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223326:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791150.223332:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791150.223337:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787791150.223347:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223352:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791150.223365:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223371:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff916fc26fa200/0xcf9477fddcf1f5b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5b7 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223378:0:22688:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791150.223381:0:22688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223386:0:22688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2c00 already unused, calling callback (ffffffffc11c1c20) 10000000:00010000:1.0:1787791150.223389:0:22688:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223404:0:22688:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787791150.223410:0:22688:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787791150.223415:0:22688:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787791150.223438:0:22688:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223444:0:22688:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787791150.223450:0:22688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223457:0:22688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff9170f39d2c00/0xcf9477fddcf1f5a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf9477fddcf1f5a9 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.223469:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791150.223471:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791150.223472:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787791150.223486:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268210176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791150.223635:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268210048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791150.223687:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791150.223734:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787791150.223741:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268209920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791150.223762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791150.223794:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210048 00000100:00100000:3.0:1787791150.223798:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210048 00010000:00010000:3.0:1787791150.223820:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 24 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.223841:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268209920 00000100:00100000:3.0:1787791150.223844:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268209920 00010000:00010000:3.0:1787791150.223878:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 25 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.223895:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787791150.223908:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc33930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+25:3641:x1874634268210048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.223919:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.223924:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 25 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.223933:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 25 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.223948:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.223977:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc33930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+25:3641:x1874634268210048:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.223983:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787791150.223999:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787791150.224005:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3641:x1874634268209920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.224012:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.224016:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 24 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.224025:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 24 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.224034:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.224080:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3641:x1874634268209920:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.224087:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787791150.224127:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268209920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787791150.224136:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3641:1874634268210048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787791150.224771:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d4c00/0xcf9477fddcf1f690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f689 expref: 23 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.224786:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209408:0@lo:104: 00010000:00010000:0.0:1787791150.224795:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9ec00/0xcf9477fddcf1f5f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f5ef expref: 22 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.224802:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209536:0@lo:104: 00000100:00100000:0.0:1787791150.224810:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209664:0@lo:104: 00000100:00100000:0.0:1787791150.224818:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209792:0@lo:104: 00000100:00100000:0.0:1787791150.224854:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268210304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791150.224902:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791150.226029:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210304 00000100:00100000:3.0:1787791150.226050:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210304 00010000:00010000:3.0:1787791150.226077:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 22 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.226106:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787791150.226115:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:3639:x1874634268210304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.226126:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.226131:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 22 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.226142:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 22 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.226157:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d4e00/0xcf9477fddcf1f5a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f5a2 expref: 22 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.226169:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.226218:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc45f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3639:x1874634268210304:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.226226:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787791150.226264:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3639:1874634268210304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787791150.226613:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791150.226794:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791150.226940:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791150.227017:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37dd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209152:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787791150.227028:0:25728:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc45f61c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25728:1874634268209280:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787791150.227060:0:25728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.227176:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210176 00000100:00100000:3.0:1787791150.227182:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210176 00010000:00010000:3.0:1787791150.227201:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 21 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.227224:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279296 00000100:00100000:3.0:1787791150.227227:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279296 00010000:00010000:3.0:1787791150.227240:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 13 pid: 22695 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.227266:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279168 00000100:00100000:3.0:1787791150.227269:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279168 00010000:00010000:3.0:1787791150.227281:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 14 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791150.227294:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787791150.227301:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:3638:x1874634268210176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.227311:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.227316:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 21 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227325:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 21 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227337:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170f39d2400/0xcf9477fddcf1f5b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf9477fddcf1f5b0 expref: 21 pid: 22694 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227351:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.227441:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:3638:x1874634268210176:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.227449:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787791150.227465:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787791150.227472:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4f3854a-b6f5-45ea-9618-5bb807c84384+14:2402:x1874634250279296:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.227480:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.227485:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 14 pid: 22695 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227518:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 14 pid: 22695 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227529:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1f8dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722415c expref: 14 pid: 22695 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227538:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.227585:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:2402:x1874634250279296:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 114us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.227591:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787791150.227628:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:3.0:1787791150.227635:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:2402:x1874634250279168:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791150.227642:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791150.227647:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227657:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227667:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff916fc3994c00/0xcf9477fddcf1f91b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241cc expref: 12 pid: 22693 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227677:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227686:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227730:0:22686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227738:0:22686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227745:0:22686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227752:0:22686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227759:0:22686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9fc00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791150.227763:0:22686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227771:0:22686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227785:0:22686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791150.227795:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791150.227814:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:2402:x1874634250279168:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 180us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791150.227820:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00010000:00010000:2.0:1787791150.228279:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791150.228820:0:25728:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.228832:0:25728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791150.228852:0:25728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9170fbd9fc00/0xcf9477fddcf1f94c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791150.234761:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268210176:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787791150.987776:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787791151.685316:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791151.685465:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279424 00000100:00100000:2.0:1787791151.685479:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279424 00000100:00100000:2.0:1787791151.685567:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:2.0:1787791151.685580:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+11:18066:x1874634250279424:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791151.685605:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791151.685635:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d927224204 expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.685674:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224204 expref: 12 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.685687:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d3800/0xcf9477fddcf1f953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224204 expref: 12 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.685699:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d3800, rc 0) 00000100:00100000:2.0:1787791151.685809:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279424:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 231us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791151.685817:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:1.0:1787791151.692361:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.692569:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279552 00000100:00100000:0.0:1787791151.692604:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279552 00000100:00100000:0.0:1787791151.692680:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:0.0:1787791151.692693:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279552:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787791151.692955:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279552:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 263us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791151.692974:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:1.0:1787791151.695801:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.696596:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279680 00000100:00100000:0.0:1787791151.696611:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279680 00000100:00100000:0.0:1787791151.696701:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:0.0:1787791151.696745:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279680:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787791151.696956:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279680:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 213us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791151.696971:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:3.0:1787791151.716436:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791151.716686:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279808 00000100:00100000:2.0:1787791151.716699:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279808 00000100:00100000:2.0:1787791151.716817:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:2.0:1787791151.716828:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+12:18066:x1874634250279808:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791151.716849:0:22694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791151.716877:0:22694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f95a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd536f2d92722420b expref: -99 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.716938:0:22694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722420b expref: 13 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.716953:0:22694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170f39d2a00/0xcf9477fddcf1f95a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722420b expref: 13 pid: 22694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.716977:0:22694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170f39d2a00, rc 0) 00000100:00100000:2.0:1787791151.717051:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18066:x1874634250279808:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 224us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791151.717059:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:1.0:1787791151.722829:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791151.723015:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250279936 00000100:00100000:2.0:1787791151.723030:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250279936 00000100:00100000:2.0:1787791151.723111:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:2.0:1787791151.723124:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18066:x1874634250279936:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791151.723647:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18066:x1874634250279936:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 523us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791151.723659:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:1.0:1787791151.725669:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.725845:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280064 00000100:00100000:0.0:1787791151.725866:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280064 00000100:00100000:0.0:1787791151.725949:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:0.0:1787791151.725971:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18066:x1874634250280064:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787791151.726157:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:18066:x1874634250280064:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 197us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791151.726167:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:3.0:1787791151.767496:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.768102:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280192 00000100:00100000:0.0:1787791151.768117:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280192 00000100:00100000:0.0:1787791151.768222:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:0.0:1787791151.768236:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc33930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:18686:x1874634250280192:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787791151.768264:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791151.768311:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224212 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768479:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768496:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768511:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768690:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768700:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.768746:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787791151.768944:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787791151.769062:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1f976 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769071:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1f976 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769079:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1f976 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791151.769117:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787791151.769122:0:22700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791151.769170:0:22700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1f976 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769194:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769202:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769209:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769216:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791151.769220:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769229:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769244:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:0.0:1787791151.769247:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791151.769259:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769266:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f968 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769283:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769290:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769296:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769308:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791151.769311:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769318:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769327:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9170c35dbc00) 00010000:00010000:0.0:1787791151.769330:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791151.769332:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769339:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f96f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769380:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224212 expref: 8 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769418:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9fc00/0xcf9477fddcf1f976 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224212 expref: 7 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.769426:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170c35db400) 00010000:00010000:0.0:1787791151.769428:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787791151.769430:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9fc00, rc 0) 00000100:00100000:0.0:1787791151.769536:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc33930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:18686:x1874634250280192:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1304us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791151.769546:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:1.0:1787791151.773502:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791151.773592:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280320 00000100:00100000:2.0:1787791151.773606:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280320 00000100:00100000:2.0:1787791151.773685:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:2.0:1787791151.773698:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:18686:x1874634250280320:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787791151.773832:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:18686:x1874634250280320:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 Request processed in 135us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791151.773840:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:1.0:1787791151.782800:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791151.783227:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280576 00000100:00100000:2.0:1787791151.783261:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280576 00000100:00100000:2.0:1787791151.783342:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787791151.783353:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:18686:x1874634250280576:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787791151.783381:0:22702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791151.783422:0:22702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2c00/0xcf9477fddcf1f97d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224219 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783524:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783542:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783751:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783775:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783782:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.783789:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784146:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ea00/0xcf9477fddcf1f992 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784157:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ea00/0xcf9477fddcf1f992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784164:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ea00/0xcf9477fddcf1f992 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791151.784181:0:22702:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787791151.784376:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784384:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784392:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784398:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791151.784403:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784419:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784434:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9170c35db400) 00010000:00010000:2.0:1787791151.784439:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791151.784445:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784452:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2800/0xcf9477fddcf1f984 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784467:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784473:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784488:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784493:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170f39d2400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791151.784496:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784502:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784509:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff916fc36fe800) 00010000:00010000:2.0:1787791151.784511:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791151.784513:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.784519:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2400/0xcf9477fddcf1f98b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.794270:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170f39d2c00/0xcf9477fddcf1f97d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224219 expref: 10 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.794298:0:22702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ea00/0xcf9477fddcf1f992 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224219 expref: 9 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.794306:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc36fe300) 00010000:00010000:2.0:1787791151.794308:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791151.794310:0:22702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15ea00, rc 0) 00000100:00100000:2.0:1787791151.794396:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18686:x1874634250280576:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 11044us (11611us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787791151.794433:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787791151.810829:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791151.811885:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280704 00000100:00100000:3.0:1787791151.811930:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280704 00000100:00100000:3.0:1787791151.812022:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:3.0:1787791151.812038:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18686:x1874634250280704:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787791151.812572:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18686:x1874634250280704:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 535us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791151.812582:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787791151.822835:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.822957:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280832 00000100:00100000:0.0:1787791151.822988:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280832 00000100:00100000:0.0:1787791151.823087:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:0.0:1787791151.823101:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:18686:x1874634250280832:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787791151.823604:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787791151.832842:0:22700:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9680us 00000100:00100000:2.0:1787791151.858519:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:18686:x1874634250280832:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 35404us (35682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791151.858539:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787791151.879447:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.879585:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250280960 00000100:00100000:0.0:1787791151.879599:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250280960 00000100:00100000:0.0:1787791151.879675:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:0.0:1787791151.879686:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18692:x1874634250280960:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787791151.879740:0:22702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791151.879765:0:22702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f9a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224220 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879845:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879935:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879951:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879971:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879978:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.879984:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880037:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880063:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880070:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880077:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791151.880083:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880092:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880108:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:0.0:1787791151.880110:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791151.880115:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880120:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e600/0xcf9477fddcf1f9a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880131:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880135:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880139:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880142:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791151.880149:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880153:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880158:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9170c35dbc00) 00010000:00010000:0.0:1787791151.880159:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791151.880161:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880164:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880248:0:22702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f9a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224220 expref: 10 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880257:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:0.0:1787791151.880258:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791151.880261:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f9a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224220 expref: 10 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791151.880268:0:22702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f800, rc 0) 00000100:00100000:0.0:1787791151.880336:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18692:x1874634250280960:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 653us (906us total) trans 0 rc 301/301 00000100:00100000:0.0:1787791151.880343:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:2.0:1787791151.886774:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791151.886975:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281088 00000100:00100000:0.0:1787791151.886988:0:22709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281088 00000100:00100000:0.0:1787791151.887049:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:0.0:1787791151.887058:0:22709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18692:x1874634250281088:12345-192.168.202.22@tcp:700:lfs.0 00000100:00100000:0.0:1787791151.887170:0:22709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18692:x1874634250281088:12345-192.168.202.22@tcp:700:lfs.0 Request processed in 113us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791151.887177:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787791151.890008:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791151.890086:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281344 00000100:00100000:3.0:1787791151.890100:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281344 00000100:00100000:3.0:1787791151.890165:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:3.0:1787791151.890176:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:18692:x1874634250281344:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:3.0:1787791151.890233:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791151.890264:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1f906 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722418d expref: 9 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.890284:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:3.0:1787791151.890289:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787791151.890367:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.890382:0:22701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 5 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.890391:0:22701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.890803:0:22701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 5 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.890833:0:22701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 5 pid: 22701 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791151.890850:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22701:1874634268210432:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787791151.891009:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791151.894180:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22701:1874634268210432:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787791151.894661:0:22701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791151.894819:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791151.895029:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281472 00000100:00100000:3.0:1787791151.895038:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281472 00010000:00010000:3.0:1787791151.895103:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 6 pid: 22701 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791151.895156:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787791151.895168:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:2403:x1874634250281472:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791151.895189:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791151.895198:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 6 pid: 22701 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895213:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 6 pid: 22701 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895240:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1f945 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272241fd expref: 6 pid: 22701 timeout: 800 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895283:0:22686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:3.0:1787791151.895289:0:22686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895299:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895308:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.895339:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791151.895428:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2403:x1874634250281472:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 262us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791151.895437:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00010000:00010000:2.0:1787791151.895532:0:22701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.895547:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.895579:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.895593:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.895606:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787791151.896248:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787791151.897495:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897516:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897539:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787791151.897569:0:22701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3cb0f7e reply state 00000000fb2fef1b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897580:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897587:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:2.0:1787791151.897590:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787791151.897594:0:22701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787791151.897600:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787791151.897609:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897616:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897623:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897629:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791151.897633:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897641:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897651:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9170c35db300) 00010000:00010000:2.0:1787791151.897654:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791151.897665:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897672:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539200/0xcf9477fddcf1f9b5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787791151.897693:0:22701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b3cb0f7e reply state 00000000fb2fef1b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897702:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791151.897734:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff916fc36fe800) 00010000:00010000:2.0:1787791151.897738:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787791151.897741:0:22701:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787791151.897852:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+10:18692:x1874634250281344:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 7674us (7853us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787791151.897861:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787791151.976968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791151.977186:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281600 00000100:00100000:3.0:1787791151.977201:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281600 00000100:00100000:3.0:1787791151.977283:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787791151.977296:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+10:18700:x1874634250281600:12345-192.168.202.22@tcp:101:lctl.0 00010000:00010000:3.0:1787791151.977329:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791151.977360:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538600/0xcf9477fddcf1f9ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224227 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977467:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538e00/0xcf9477fddcf1f9d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977485:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538e00/0xcf9477fddcf1f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977519:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538e00/0xcf9477fddcf1f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787791151.977586:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787791151.977591:0:22700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787791151.977639:0:22700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538e00/0xcf9477fddcf1f9d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977671:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538600/0xcf9477fddcf1f9ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224227 expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977694:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538e00/0xcf9477fddcf1f9d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224227 expref: 11 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791151.977775:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:3.0:1787791151.977779:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787791151.977784:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538e00, rc 0) 00000100:00100000:3.0:1787791151.977868:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+11:18700:x1874634250281600:12345-192.168.202.22@tcp:101:lctl.0 Request processed in 575us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791151.977876:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:1.0:1787791152.004280:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.004440:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281728 00000100:00100000:0.0:1787791152.004453:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281728 00000100:00100000:0.0:1787791152.004579:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:0.0:1787791152.004592:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:18701:x1874634250281728:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787791152.004620:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791152.004648:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f9d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722422e expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.004794:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.004812:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.004824:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791152.004889:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787791152.004894:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791152.005230:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.005265:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1f9d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722422e expref: 7 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.005308:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e000/0xcf9477fddcf1f9df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722422e expref: 6 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.005317:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:0.0:1787791152.005321:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787791152.005325:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e000, rc 0) 00000100:00100000:0.0:1787791152.005464:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18701:x1874634250281728:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 874us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.005472:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:2.0:1787791152.008452:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 10000000:01000000:3.0:1787791152.010848:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787791152.010868:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f4f9c800 from 13 10000000:01000000:3.0:1787791152.010875:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787791152.010955:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.010967:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.011004:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.011037:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.011149:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.011213:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791152.011261:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210560 00000100:00100000:3.0:1787791152.011269:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210560 00000100:00100000:3.0:1787791152.011334:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787791152.011344:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+20:22697:x1874634268210560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791152.011360:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791152.011377:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539400/0xcf9477fddcf1f9ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1f9e6 expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.011428:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539400/0xcf9477fddcf1f9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1f9e6 expref: 21 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.011442:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539400/0xcf9477fddcf1f9ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1f9e6 expref: 21 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.011451:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539400, rc 0) 00000100:00100000:3.0:1787791152.011495:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.011502:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787791152.011654:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791152.011673:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f9ed expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.011692:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1f9ed expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.011808:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.011836:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.011854:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791152.011870:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210688 00000100:00100000:3.0:1787791152.011874:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210688 00000100:00100000:3.0:1787791152.011896:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787791152.011902:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.012039:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.012046:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787791152.012074:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.012103:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.012145:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.012159:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791152.012171:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210816 00000100:00100000:3.0:1787791152.012175:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210816 00000100:00100000:3.0:1787791152.012196:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787791152.012204:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.012286:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.012292:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787791152.012336:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787791152.013219:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281856 00000100:00100000:1.0:1787791152.013229:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281856 00000100:00100000:1.0:1787791152.013289:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:1.0:1787791152.013298:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+6:18701:x1874634250281856:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787791152.013314:0:24774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791152.013337:0:24774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1f9f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224235 expref: -99 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013489:0:24774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013506:0:24774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013518:0:24774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013546:0:24774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013628:0:24774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013636:0:24774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013754:0:24774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013762:0:24774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.013768:0:24774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787791152.013812:0:24774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787791152.013816:0:24774:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787791152.013839:0:24774:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014014:0:24774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014022:0:24774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014029:0:24774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014046:0:24774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791152.014123:0:24774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014132:0:24774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014147:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:1.0:1787791152.014151:0:24774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787791152.014156:0:24774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014162:0:24774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1f9fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014178:0:24774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014184:0:24774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014189:0:24774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014194:0:24774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791152.014197:0:24774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014204:0:24774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014223:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff916fc36fe800) 00010000:00010000:1.0:1787791152.014226:0:24774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787791152.014229:0:24774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014235:0:24774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014269:0:24774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995600/0xcf9477fddcf1f9f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224235 expref: 8 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014283:0:24774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224235 expref: 7 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.014290:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:1.0:1787791152.014292:0:24774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787791152.014295:0:24774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994400, rc 0) 00000100:00100000:1.0:1787791152.014375:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+7:18701:x1874634250281856:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1078us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.014646:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00010000:00010000:1.0:1787791152.015511:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787791152.021519:0:25743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:0.0:1787791152.023005:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.023180:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250281984 00000100:00100000:3.0:1787791152.023194:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250281984 00000100:00100000:3.0:1787791152.023319:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787791152.023332:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:18701:x1874634250281984:12345-192.168.202.22@tcp:900:lfs.0 00000100:00100000:3.0:1787791152.023456:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:18701:x1874634250281984:12345-192.168.202.22@tcp:900:lfs.0 Request processed in 126us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.023466:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000020:01000000:2.0:1787791152.023542:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787791152.023590:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787791152.023604:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f9ed expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.023617:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538600/0xcf9477fddcf1f9e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1f9ed expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787791152.023630:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787791152.023633:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170c7da0000 from 13 10000000:01000000:2.0:1787791152.023636:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787791152.023693:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.023721:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.023733:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791152.023761:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.023820:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791152.023864:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791152.023887:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268210944 00000100:00100000:2.0:1787791152.023892:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268210944 00000100:00080000:0.0:1787791152.024081:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787791152.024569:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787791152.024578:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+21:22697:x1874634268210944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791152.024592:0:22695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.024610:0:22695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9170fe15f400/0xcf9477fddcf1fa17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1fa10 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.024640:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9170fe15f400/0xcf9477fddcf1fa17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa10 expref: 22 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.024652:0:22695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9170fe15f400/0xcf9477fddcf1fa17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa10 expref: 22 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.024662:0:22695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15f400, rc 0) 00000100:00100000:2.0:1787791152.024743:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5833c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268210944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.024750:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787791152.024820:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268210944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787791152.024840:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa17 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.024850:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1fa17 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791152.025034:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.025083:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791152.025112:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791152.025129:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211072 00000100:00100000:2.0:1787791152.025133:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211072 00000100:00100000:2.0:1787791152.025159:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787791152.025167:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268211072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.025300:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268211072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.025308:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787791152.025343:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.025372:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.025427:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787791152.025440:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c34b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787791152.025452:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211200 00000100:00100000:2.0:1787791152.025455:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211200 00000100:00100000:2.0:1787791152.025476:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787791152.025483:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268211200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.026017:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268211200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 533us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.026032:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787791152.027292:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787791152.030200:0:25744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000100:00100000:1.0:1787791152.030782:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.030976:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250282240 00000100:00100000:3.0:1787791152.030989:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250282240 00000100:00100000:3.0:1787791152.031137:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:3.0:1787791152.031150:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+7:18701:x1874634250282240:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787791152.031178:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791152.031205:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fa1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722423c expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787791152.031347:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787791152.031504:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fa1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722423c expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.031523:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:3.0:1787791152.031527:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787791152.031533:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fa1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722423c expref: 9 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.031548:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538400, rc 0) 00000100:00100000:3.0:1787791152.031893:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+8:18701:x1874634250282240:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 745us (1118us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1787791152.031912:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 32 00000020:01000000:0.0:1787791152.032072:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787791152.032111:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787791152.032123:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa17 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.032133:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fe15fc00/0xcf9477fddcf1fa10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa17 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787791152.032145:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787791152.032149:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170ce838000 from 13 10000000:01000000:0.0:1787791152.032153:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787791152.032189:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.032197:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.032221:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791152.032250:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787791152.032316:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.032371:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc460ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787791152.032561:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211328 00000100:00100000:3.0:1787791152.032568:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211328 00000100:00100000:3.0:1787791152.032614:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787791152.032624:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+22:22697:x1874634268211328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791152.032634:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791152.032647:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1fa33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1fa2c expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.032670:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1fa33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa2c expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.032680:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc4539200/0xcf9477fddcf1fa33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa2c expref: 23 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.032690:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539200, rc 0) 00000100:00100000:3.0:1787791152.032768:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.032775:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787791152.032948:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24da580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787791152.032967:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa33 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.032977:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1fa33 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791152.033078:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787791152.033110:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791152.033136:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82780 going to sleep for 11 seconds 00000100:00100000:0.0:1787791152.033320:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211456 00000100:00100000:0.0:1787791152.033326:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211456 00000100:00100000:0.0:1787791152.033367:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787791152.033375:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787791152.033510:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f5831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.033517:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787791152.033700:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787791152.033778:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787791152.033829:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791152.033850:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82780 going to sleep for 11 seconds 00000100:00100000:0.0:1787791152.034014:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211584 00000100:00100000:0.0:1787791152.034020:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211584 00000100:00100000:0.0:1787791152.034118:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787791152.034128:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787791152.034229:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.034237:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787791152.034317:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787791152.035851:0:25745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787791152.039684:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787791152.039759:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787791152.039774:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa33 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.039787:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff9170fbd9e600/0xcf9477fddcf1fa2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa33 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787791152.039824:0:22697:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787791152.039828:0:22697:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9170f39e2000 from 13 10000000:01000000:3.0:1787791152.039831:0:22697:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787791152.039888:0:22697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.039907:0:22697:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.039919:0:22697:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.039953:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.040057:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.040110:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787791152.040420:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211712 00000100:00100000:1.0:1787791152.040430:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211712 00000100:00100000:1.0:1787791152.040501:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787791152.040514:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+23:22697:x1874634268211712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787791152.040532:0:22693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791152.040551:0:22693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1fa41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf9477fddcf1fa3a expref: -99 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.040730:0:22693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1fa41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa3a expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.040744:0:22693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff916fc3995600/0xcf9477fddcf1fa41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf9477fddcf1fa3a expref: 24 pid: 22693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.040754:0:22693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995600, rc 0) 00000100:00100000:1.0:1787791152.040817:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268211712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 306us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.040837:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787791152.041190:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787791152.041213:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa41 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.041223:0:22697:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf9477fddcf1fa41 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.041312:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.041349:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.041390:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787791152.041446:0:22694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211840 00000100:00100000:1.0:1787791152.041452:0:22694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211840 00000100:00100000:1.0:1787791152.041522:0:22694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787791152.041532:0:22694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268211840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787791152.041694:0:22694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268211840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.041701:0:22694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787791152.041799:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.041830:0:22697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787791152.041907:0:22697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.042144:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.042485:0:22697:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c6fc6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787791152.042614:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268211968 00000100:00100000:2.0:1787791152.042621:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268211968 00000100:00100000:2.0:1787791152.042659:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787791152.042669:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268211968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787791152.043016:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:22697:x1874634268211968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.043025:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787791152.043314:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250282496 00000100:00100000:1.0:1787791152.043320:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250282496 00000100:00100000:1.0:1787791152.043371:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:1.0:1787791152.043380:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+8:18701:x1874634250282496:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:1.0:1787791152.043450:0:24774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791152.043483:0:24774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fa09 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224235 expref: 8 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.043503:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:1.0:1787791152.043510:0:24774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787791152.043538:0:24774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.043632:0:24774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.043645:0:24774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787791152.044135:0:24774:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080b59d9e reply state 000000000ef07c4c transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.044163:0:24774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.044169:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:1.0:1787791152.044172:0:24774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787791152.044176:0:24774:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787791152.044186:0:24774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787791152.044280:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+9:18701:x1874634250282496:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 901us (2138us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787791152.044288:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:3.0:1787791152.047372:0:22697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:22697:1874634268211968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787791152.048473:0:25746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787791152.048741:0:22697:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787791152.048769:0:22697:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787791152.048783:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa41 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.048819:0:22697:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff916fc4538a00/0xcf9477fddcf1fa3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf9477fddcf1fa41 expref: -99 pid: 22697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791152.049488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.049849:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250282752 00000100:00100000:0.0:1787791152.049860:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250282752 00000100:00100000:0.0:1787791152.050022:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:0.0:1787791152.050035:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+9:18701:x1874634250282752:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:0.0:1787791152.050352:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+10:18701:x1874634250282752:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 319us (869us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1787791152.050360:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:1.0:1787791152.054020:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.054212:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283008 00000100:00100000:2.0:1787791152.054225:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283008 00000100:00100000:2.0:1787791152.054300:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:2.0:1787791152.054312:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+10:18701:x1874634250283008:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787791152.054341:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.054368:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224243 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054483:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054502:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054519:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054568:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054576:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054583:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791152.054752:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787791152.054848:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054857:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054863:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054870:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791152.054875:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054884:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054909:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:2.0:1787791152.054913:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791152.054919:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054939:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054959:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054966:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054972:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054977:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15e600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791152.054980:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054986:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.054994:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff916fc36fe800) 00010000:00010000:2.0:1787791152.054997:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791152.055000:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.055006:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.055239:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224243 expref: 12 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.055264:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:2.0:1787791152.055267:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787791152.055271:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224243 expref: 12 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.055282:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15e000, rc 0) 00000100:00100000:2.0:1787791152.055371:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+11:18701:x1874634250283008:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1060us (1365us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1787791152.055380:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:3.0:1787791152.062140:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.062508:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283136 00000100:00100000:2.0:1787791152.062521:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283136 00000100:00100000:2.0:1787791152.062685:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:2.0:1787791152.062698:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+11:18701:x1874634250283136:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:2.0:1787791152.062778:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.062804:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fa00/0xcf9477fddcf1fa6b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722424a expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063200:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063220:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063232:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791152.063262:0:22700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787791152.063287:0:22700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787791152.063314:0:22700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063349:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fa00/0xcf9477fddcf1fa6b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 13 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063372:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.063381:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:2.0:1787791152.063385:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787791152.063389:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15e400, rc 0) 00000100:00100000:2.0:1787791152.063516:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:18701:x1874634250283136:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 820us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.063526:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:3.0:1787791152.069164:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.069272:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283264 00000100:00100000:1.0:1787791152.069285:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283264 00000100:00100000:1.0:1787791152.069394:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:1.0:1787791152.069416:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:18701:x1874634250283264:12345-192.168.202.22@tcp:37:lfs.0 00000100:00100000:1.0:1787791152.074886:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:18701:x1874634250283264:12345-192.168.202.22@tcp:37:lfs.0 Request processed in 5465us (6172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.074913:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787791152.078390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.078650:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283520 00000100:00100000:0.0:1787791152.078664:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283520 00000100:00100000:2.0:1787791152.078938:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787791152.078953:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fc8a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:18701:x1874634250283520:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787791152.079377:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fc8a7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce68e33a-1a74-43fd-9813-d959cabf93bb+13:18701:x1874634250283520:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 426us (998us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787791152.079386:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:1.0:1787791152.129527:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.130021:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283648 00000100:00100000:2.0:1787791152.130036:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283648 00000100:00100000:2.0:1787791152.130140:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:2.0:1787791152.130152:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+11:18707:x1874634250283648:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:2.0:1787791152.130180:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.130207:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fa00/0xcf9477fddcf1fa79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224251 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130314:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130331:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130343:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130354:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130361:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130367:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130481:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa8e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130492:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130499:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791152.130540:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787791152.130544:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787791152.130605:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130630:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130636:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130644:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130650:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15e000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791152.130655:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130663:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130678:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:2.0:1787791152.130681:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791152.130686:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130694:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1fa80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130768:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130775:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130780:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130790:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15e600 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791152.130794:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130799:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130806:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff916fc36fe800) 00010000:00010000:2.0:1787791152.130809:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791152.130811:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130816:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e600/0xcf9477fddcf1fa87 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130845:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fa00/0xcf9477fddcf1fa79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224251 expref: 13 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130866:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15ee00/0xcf9477fddcf1fa8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224251 expref: 12 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.130873:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:2.0:1787791152.130875:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787791152.130878:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15ee00, rc 0) 00000100:00100000:2.0:1787791152.130971:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+12:18707:x1874634250283648:12345-192.168.202.22@tcp:101:bash.0 Request processed in 821us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.130981:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:3.0:1787791152.134800:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.135025:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250283776 00000100:00100000:1.0:1787791152.135038:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250283776 00000100:00100000:1.0:1787791152.135124:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787791152.135135:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:18707:x1874634250283776:12345-192.168.202.22@tcp:900:bash.0 00000100:00100000:1.0:1787791152.135244:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:18707:x1874634250283776:12345-192.168.202.22@tcp:900:bash.0 Request processed in 110us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.135273:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787791152.138524:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.138951:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250284032 00000100:00100000:1.0:1787791152.138966:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250284032 00000100:00100000:1.0:1787791152.139045:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:1.0:1787791152.139068:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc33912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+12:18707:x1874634250284032:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:1.0:1787791152.139094:0:22702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791152.139122:0:22702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1fa95 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224258 expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.139262:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.139280:0:22702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.139289:0:22702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.139332:0:22702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 12 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.139347:0:22702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 12 pid: 22700 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791152.139362:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f77c7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268212096:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787791152.139482:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82300 going to sleep for 11 seconds 00000100:00100000:1.0:1787791152.143134:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f77c7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268212096:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787791152.143199:0:22702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.145183:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.145401:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250284160 00000100:00100000:0.0:1787791152.145425:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250284160 00010000:00010000:0.0:1787791152.145482:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 13 pid: 22700 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791152.145532:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787791152.145545:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce68e33a-1a74-43fd-9813-d959cabf93bb+13:2402:x1874634250284160:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787791152.145571:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791152.145580:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 13 pid: 22700 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145596:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 13 pid: 22700 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145652:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e400/0xcf9477fddcf1fa72 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722424a expref: 13 pid: 22700 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145676:0:22687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:0.0:1787791152.145682:0:22687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145695:0:22687:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145742:0:22687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.145783:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791152.145851:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:2402:x1874634250284160:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 309us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.145860:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00010000:00010000:1.0:1787791152.146192:0:22702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.146202:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149047:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149073:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149088:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149630:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149640:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149660:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787791152.149672:0:22702:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787791152.149702:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149747:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149764:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149770:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995000 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791152.149774:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149782:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149795:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:1.0:1787791152.149799:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787791152.149804:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149811:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995000/0xcf9477fddcf1fa9c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787791152.149826:0:22702:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000402af982 reply state 0000000093f34403 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149849:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149855:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff916fc268fe00) 00010000:00010000:1.0:1787791152.149858:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787791152.149862:0:22702:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787791152.149907:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995e00/0xcf9477fddcf1fa95 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 15 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149924:0:22702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 14 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.149937:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791152.149939:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787791152.149942:0:22702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3995400, rc 0) 00000100:00100000:1.0:1787791152.150023:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc33912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+15:18707:x1874634250284032:12345-192.168.202.22@tcp:101:bash.0 Request processed in 10957us (11511us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1787791152.150032:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:3.0:1787791152.166352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.166603:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250284288 00000100:00100000:2.0:1787791152.166649:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250284288 00000100:00100000:0.0:1787791152.167306:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:0.0:1787791152.167325:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3390f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+15:18707:x1874634250284288:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787791152.167361:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791152.167389:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fab8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722425f expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167492:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167509:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167535:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791152.167601:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787791152.167607:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791152.167636:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167648:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167680:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fab8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 17 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167754:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 16 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.167765:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:0.0:1787791152.167768:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787791152.167772:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f000, rc 0) 00000100:00100000:0.0:1787791152.168173:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3390f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:18707:x1874634250284288:12345-192.168.202.22@tcp:101:bash.0 Request processed in 853us (1832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.168183:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:2.0:1787791152.172518:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.173820:0:22704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250284544 00000100:00100000:1.0:1787791152.173837:0:22704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250284544 00000100:00100000:1.0:1787791152.174233:0:22704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:1.0:1787791152.174246:0:22704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:18707:x1874634250284544:12345-192.168.202.22@tcp:35:bash.0 00000100:00100000:1.0:1787791152.174696:0:22704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+17:18707:x1874634250284544:12345-192.168.202.22@tcp:35:bash.0 Request processed in 450us (2192us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1787791152.174742:0:22704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000040:00080000:1.0:1787791152.203829:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787791152.275129:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.276773:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250284800 00000100:00100000:0.0:1787791152.276791:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250284800 00000100:00100000:0.0:1787791152.277112:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787791152.277128:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3393c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+17:18717:x1874634250284800:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787791152.277163:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791152.277209:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224266 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791152.277345:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787791152.277490:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fac6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224266 expref: 19 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.277507:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff916fc2535400) 00010000:00010000:0.0:1787791152.277511:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787791152.277517:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224266 expref: 19 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.277534:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ec00, rc 0) 00000100:00100000:0.0:1787791152.277645:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3393c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+18:18717:x1874634250284800:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 521us (2532us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787791152.277655:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:3.0:1787791152.280831:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.281159:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250285056 00000100:00100000:1.0:1787791152.281171:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250285056 00000100:00100000:1.0:1787791152.281244:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787791152.281256:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+18:18717:x1874634250285056:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787791152.281654:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+19:18717:x1874634250285056:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 399us (836us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1787791152.281663:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787791152.314775:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.314875:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250285312 00000100:00100000:3.0:1787791152.314889:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250285312 00000100:00100000:3.0:1787791152.314956:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:3.0:1787791152.314968:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+19:18720:x1874634250285312:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787791152.315003:0:22702:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791152.315032:0:22702:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fad4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722426d expref: -99 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.315219:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fadb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.315237:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fadb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.315250:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fadb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787791152.315275:0:22702:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787791152.315429:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fad4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722426d expref: 22 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.315452:0:22702:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fadb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722426d expref: 21 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.315462:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.315465:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787791152.315469:0:22702:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538400, rc 0) 00000100:00100000:3.0:1787791152.315548:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18720:x1874634250285312:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 582us (789us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787791152.315780:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:0.0:1787791152.319645:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.320034:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250285440 00000100:00100000:3.0:1787791152.320059:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250285440 00000100:00100000:3.0:1787791152.320136:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:3.0:1787791152.320148:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18720:x1874634250285440:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787791152.320240:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320261:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320275:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320321:0:22700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320348:0:22700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320357:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320364:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:3.0:1787791152.320369:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320377:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320392:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.320395:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787791152.320401:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.320418:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fae9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.320520:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18720:x1874634250285440:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 373us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.320530:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:2.0:1787791152.324076:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.324191:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250285696 00000100:00100000:1.0:1787791152.324205:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250285696 00000100:00100000:1.0:1787791152.324305:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787791152.324318:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18720:x1874634250285696:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787791152.324663:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+22:18720:x1874634250285696:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 347us (603us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1787791152.324671:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787791152.331932:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.332043:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250285824 00000100:00100000:3.0:1787791152.332066:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250285824 00000100:00100000:3.0:1787791152.332157:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:3.0:1787791152.332170:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+22:2401:x1874634250285824:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791152.332194:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791152.332247:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fadb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722426d expref: 22 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.332270:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.332277:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791152.332352:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:2401:x1874634250285824:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 185us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.332362:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000040:00080000:0.0:1787791152.459635:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787791152.460451:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3391e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268212224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787791152.460561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.460750:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268212224 00000100:00100000:3.0:1787791152.460761:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268212224 00000100:00100000:3.0:1787791152.460835:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787791152.460847:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268212224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787791152.460886:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787791152.460948:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268212224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.460957:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1787791152.461026:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787791152.461204:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3391e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268212224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787791152.616570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.616745:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286080 00000100:00100000:2.0:1787791152.616759:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286080 00000100:00100000:2.0:1787791152.616837:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:2.0:1787791152.616857:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18751:x1874634250286080:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:2.0:1787791152.616891:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.616921:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1faf0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224274 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.617087:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1faf7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.617105:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1faf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.617119:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1faf7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791152.617133:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787791152.617301:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e000/0xcf9477fddcf1faf0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224274 expref: 24 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.617328:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1faf7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224274 expref: 23 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.617361:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:2.0:1787791152.617364:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787791152.617368:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15f800, rc 0) 00000100:00100000:2.0:1787791152.617463:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:18751:x1874634250286080:12345-192.168.202.22@tcp:101:cat.0 Request processed in 616us (918us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1787791152.617472:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:2.0:1787791152.622419:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.622478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.622577:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286464 00000100:00100000:3.0:1787791152.622591:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286464 00000100:00100000:3.0:1787791152.622690:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:3.0:1787791152.622741:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:2403:x1874634250286464:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791152.622768:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791152.622801:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1faf7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224274 expref: 23 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.622824:0:22686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.622831:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791152.622904:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+22:2403:x1874634250286464:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 204us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.622931:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:1.0:1787791152.623577:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286336 00000100:00100000:1.0:1787791152.623587:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286336 00000100:00100000:1.0:1787791152.623647:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787791152.623657:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+22:18751:x1874634250286336:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:1.0:1787791152.624061:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:18751:x1874634250286336:12345-192.168.202.22@tcp:35:cat.0 Request processed in 404us (1668us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1787791152.624068:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787791152.688635:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.688755:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286720 00000100:00100000:0.0:1787791152.688768:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286720 00000100:00100000:0.0:1787791152.688835:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:0.0:1787791152.688846:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:18757:x1874634250286720:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:0.0:1787791152.688882:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791152.688908:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb05 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722427b expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689053:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689085:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 24 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689094:0:24230:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 24 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689102:0:24230:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689140:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 24 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689155:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 24 pid: 24230 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791152.689170:0:24230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1874634268212352:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787791152.689285:0:24230:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 24 pid: 22702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791152.689295:0:24230:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 24 pid: 22702 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791152.689304:0:24230:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1874634268212480:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787791152.689325:0:24230:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc460ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791152.693219:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791152.693266:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.693386:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286848 00000100:00100000:3.0:1787791152.693398:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286848 00010000:00010000:3.0:1787791152.693459:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 25 pid: 24230 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.693505:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250286976 00000100:00100000:3.0:1787791152.693508:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250286976 00010000:00010000:3.0:1787791152.693521:0:22687:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 26 pid: 22702 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791152.693539:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787791152.693561:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+26:2402:x1874634250286848:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791152.693602:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791152.693611:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 26 pid: 24230 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693625:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 26 pid: 24230 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693654:0:22687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.693659:0:22687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693668:0:22687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693674:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791152.693780:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24dbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+26:2402:x1874634250286848:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 231us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.693790:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787791152.693811:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787791152.693818:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+25:2402:x1874634250286976:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791152.693827:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791152.693832:0:22687:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 25 pid: 22702 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693842:0:22687:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 25 pid: 22702 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693865:0:22687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.693870:0:22687:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693878:0:22687:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693886:0:22687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.693907:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791152.693926:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcb9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+25:2402:x1874634250286976:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 109us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.693932:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00010000:00010000:2.0:1787791152.694739:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f000/0xcf9477fddcf1fabf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d92722425f expref: 24 pid: 24230 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791152.694765:0:24230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24dad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1874634268212352:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787791152.694779:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995400/0xcf9477fddcf1faaa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224258 expref: 23 pid: 22702 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791152.694788:0:24230:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24230:1874634268212480:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787791152.694817:0:24230:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.694827:0:24230:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.694833:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787791152.694871:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787791152.695078:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb05 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722427b expref: 24 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.695095:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9e400/0xcf9477fddcf1fb0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722427b expref: 23 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.695103:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:2.0:1787791152.695106:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787791152.695109:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9e400, rc 0) 00000100:00100000:2.0:1787791152.695171:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:18757:x1874634250286720:12345-192.168.202.22@tcp:101:dd.0 Request processed in 6326us (6549us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1787791152.695180:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:0.0:1787791152.699676:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.699999:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250287104 00000100:00100000:3.0:1787791152.700013:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250287104 00000100:00100000:3.0:1787791152.700100:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:3.0:1787791152.700133:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+23:18757:x1874634250287104:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787791152.700164:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791152.700190:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb1a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224282 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700233:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700250:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700263:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700418:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb1a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 25 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700443:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 24 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.700452:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.700455:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787791152.700460:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539800, rc 0) 00000100:00100000:3.0:1787791152.700569:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+24:18757:x1874634250287104:12345-192.168.202.22@tcp:101:dd.0 Request processed in 438us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.700577:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:1.0:1787791152.704393:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.704503:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250287360 00000100:00100000:3.0:1787791152.704516:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250287360 00000100:00100000:3.0:1787791152.704600:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:3.0:1787791152.704631:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+24:18757:x1874634250287360:12345-192.168.202.22@tcp:36:dd.0 00010000:00010000:3.0:1787791152.704976:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.704999:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.705012:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787791152.705060:0:22702:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787791152.705084:0:22702:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be78ac55 reply state 00000000b9a46492 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.705098:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.705105:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.705108:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787791152.705113:0:22702:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787791152.705206:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250287360:12345-192.168.202.22@tcp:36:dd.0 Request processed in 577us (828us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787791152.705215:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000020:00080000:3.0:1787791152.705221:0:22702:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787791152.708313:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.708451:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250287488 00000100:00100000:2.0:1787791152.708465:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250287488 00000100:00100000:2.0:1787791152.708542:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:2.0:1787791152.708563:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250287488:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:2.0:1787791152.708595:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791152.708622:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f200/0xcf9477fddcf1fb2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224289 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.708701:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f200/0xcf9477fddcf1fb2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224289 expref: 28 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.708763:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f200/0xcf9477fddcf1fb2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224289 expref: 28 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.708814:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:2.0:1787791152.708818:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787791152.708823:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15f200, rc 0) 00000100:00100000:2.0:1787791152.708892:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18757:x1874634250287488:12345-192.168.202.22@tcp:101:dd.0 Request processed in 340us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.708900:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:0.0:1787791152.719692:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791152.719817:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250287744 00000100:00100000:3.0:1787791152.719830:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250287744 00000100:00100000:3.0:1787791152.719918:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:3.0:1787791152.719931:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18757:x1874634250287744:12345-192.168.202.22@tcp:103:dd.0 00010000:00010000:3.0:1787791152.719951:0:22687:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791152.719985:0:22687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f200/0xcf9477fddcf1fb2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224289 expref: 28 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791152.720029:0:22687:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791152.720036:0:22687:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791152.720118:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250287744:12345-192.168.202.22@tcp:103:dd.0 Request processed in 189us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.720127:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:1.0:1787791152.723187:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791152.723312:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250287872 00000100:00100000:2.0:1787791152.723326:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250287872 00000100:00100000:2.0:1787791152.723413:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787791152.723425:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f77c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250287872:12345-192.168.202.22@tcp:58:dd.0 00010000:00010000:2.0:1787791152.723588:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.723611:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791152.723625:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787791152.725638:0:22701:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787791152.725679:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1787791152.725864:0:22701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1787791152.726131:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f77c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250287872:12345-192.168.202.22@tcp:58:dd.0 Request processed in 2700us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.726144:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787791152.728615:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791152.728800:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288000 00000100:00100000:1.0:1787791152.728813:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288000 00000100:00100000:1.0:1787791152.728893:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:1.0:1787791152.728906:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+27:18757:x1874634250288000:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:1.0:1787791152.728932:0:24774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791152.728962:0:24774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224290 expref: -99 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729036:0:24774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729065:0:24774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 28 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729092:0:24774:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729112:0:24774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 28 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729128:0:24774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791152.729132:0:24774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787791152.729137:0:24774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 28 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791152.729144:0:24774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994c00, rc 0) 00000100:00100000:1.0:1787791152.729220:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170f67f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18757:x1874634250288000:12345-192.168.202.22@tcp:101:dd.0 Request processed in 317us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.729228:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787791152.971342:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268212608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787791152.971482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.971769:0:24209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268212608 00000100:00100000:0.0:1787791152.971781:0:24209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268212608 00000100:00100000:0.0:1787791152.971877:0:24209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787791152.971891:0:24209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268212608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787791152.971936:0:24209:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791152.971998:0:24209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874634268212608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 111us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.972006:0:24209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787791152.972910:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787791152.972925:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787791152.972944:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268212736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787791152.972997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.973089:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1874634268212608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787791152.974802:0:25495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268212736 00000100:00100000:1.0:1787791152.974818:0:25495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268212736 00000100:00100000:1.0:1787791152.974922:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787791152.974935:0:25495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc33903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268212736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787791152.974967:0:25495:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00080000:0.0:1787791152.975565:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787791152.977173:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268212992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787791152.977246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.977315:0:24210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268212992 00000100:00100000:0.0:1787791152.977333:0:24210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268212992 00000100:00100000:0.0:1787791152.977412:0:24210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791152.977421:0:24210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268212992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787791152.977447:0:24210:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787791152.977496:0:24210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268212992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.977504:0:24210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787791152.977542:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787791152.977607:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268212992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787791152.977752:0:25495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc33903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268212736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2819us (4753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.977762:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787791152.980771:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787791152.981073:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787791152.981100:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268213120:0@lo:400:kworker.0 00000100:00100000:1.0:1787791152.981193:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791152.981267:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213120 00000100:00100000:1.0:1787791152.981275:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213120 00000100:00100000:1.0:1787791152.981352:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787791152.981362:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268213120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791152.981450:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874634268213120:12345-0@lo:400:kworker.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.981458:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787791152.981522:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1874634268213120:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.982788:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268212736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787791152.982816:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787791152.982828:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268213248:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.982899:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791152.983578:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213248 00000100:00100000:1.0:1787791152.983588:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213248 00000100:00100000:1.0:1787791152.983660:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787791152.983673:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3390780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268213248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791152.984264:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3390780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874634268213248:12345-0@lo:400:kworker.0 Request processed in 593us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791152.984273:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787791152.984391:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874634268213248:0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.985667:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170f67f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268212864:0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.985964:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.986317:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268212864 00000100:00100000:3.0:1787791152.986337:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268212864 00000100:00100000:3.0:1787791152.986511:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787791152.986535:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3638:x1874634268212864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.986919:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3+24:3638:x1874634268212864:12345-0@lo:400:kworker.0 Request processed in 387us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791152.986943:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787791152.987335:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170f67f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:fd0dfdf8-c7e0-4d59-a054-6f1d9e06eda3:3638:1874634268212864:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.989982:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268213376:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.991487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.993201:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268213760:0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.993297:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.993362:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787791152.993381:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268213888:0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.993418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.993484:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213760 00000100:00100000:0.0:1787791152.993493:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213760 00000100:00100000:0.0:1787791152.993651:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213888 00000100:00100000:0.0:1787791152.993656:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213888 00000100:00100000:0.0:1787791152.993687:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787791152.993700:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268213760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.993975:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874634268213760:12345-0@lo:400:kworker.0 Request processed in 278us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.993985:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787791152.994008:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787791152.994015:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268213888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.994044:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874634268213888:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.994050:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787791152.995132:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787791152.995140:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787791152.995200:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1874634268213888:0@lo:400:kworker.0 00010000:00080000:0.0:1787791152.995221:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc37661c0 x1874634268213760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787791152.995234:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc37661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1874634268213760:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.995444:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268213632:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.995503:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.995557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787791152.995566:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268213504:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.995591:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787791152.995608:0:3641:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268214016:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.995627:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791152.997175:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213632 00000100:00100000:0.0:1787791152.997193:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213632 00000100:00100000:0.0:1787791152.997293:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213504 00000100:00100000:0.0:1787791152.997297:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213504 00000100:00100000:0.0:1787791152.997316:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268214016 00000100:00100000:0.0:1787791152.997319:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268214016 00000100:00100000:2.0:1787791152.997676:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787791152.997765:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791152.997887:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874634268213632:12345-0@lo:400:kworker.0 Request processed in 130us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.997897:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787791152.997924:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787791152.997930:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268213504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787791152.997961:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874634268213504:12345-0@lo:400:kworker.0 Request processed in 32us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791152.997967:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787791152.998343:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787791152.998351:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268214016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787791152.998393:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874634268214016:12345-0@lo:400:kworker.0 Request processed in 43us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791152.998409:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787791152.999767:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787791152.999778:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787791152.999849:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc3b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874634268213504:0@lo:400:kworker.0 00010000:00080000:3.0:1787791152.999872:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff916fc1cd1e00 x1874634268214016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787791168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787791152.999885:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1874634268214016:0@lo:400:kworker.0 00000100:00100000:3.0:1787791152.999900:0:3641:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170e4f452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3641:1874634268213632:0@lo:400:kworker.0 00000100:00100000:1.0:1787791153.003769:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268213376 00000100:00100000:1.0:1787791153.003789:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268213376 00000100:00100000:1.0:1787791153.003893:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787791153.003905:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3393840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268213376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787791153.004048:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3393840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874634268213376:12345-0@lo:400:kworker.0 Request processed in 146us (12567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.004062:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787791153.005475:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fbdca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1874634268213376:0@lo:400:kworker.0 00010000:00010000:1.0:1787791153.037535:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791153.483070:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787791153.483105:0:3640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268214144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787791153.483198:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787791153.483562:0:22736:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787791153.483587:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787791153.483625:0:22736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787791153.483633:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787791153.483803:0:22736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe4012c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22736:1874634268214272:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787791153.483893:0:22736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787791153.484060:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268214144 00000100:00100000:0.0:1787791153.484070:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268214144 00000100:00100000:0.0:1787791153.484132:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787791153.484144:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268214144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787791153.484194:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1787791153.484260:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874634268214144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.484267:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787791153.484622:0:3640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1874634268214144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787791153.485268:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787791153.485287:0:3639:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268214400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787791153.485463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787791153.485564:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268214400 00000100:00100000:0.0:1787791153.485571:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268214400 00000100:00100000:0.0:1787791153.485623:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787791153.485633:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc33921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268214400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787791153.485668:0:22706:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787791153.485743:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc33921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874634268214400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.485750:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787791153.485810:0:3639:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc1cd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1874634268214400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787791153.491595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.492005:0:22736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe4012c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22736:1874634268214272:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787791153.492226:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288128 00000100:00100000:0.0:1787791153.492235:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288128 00000100:00100000:0.0:1787791153.492390:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:0.0:1787791153.492420:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18758:x1874634250288128:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787791153.492463:0:24774:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787791153.492620:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18758:x1874634250288128:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 204us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.492629:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00080000:3.0:1787791153.495697:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787791153.502601:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.502766:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288256 00000100:00100000:0.0:1787791153.502781:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288256 00000100:00100000:0.0:1787791153.502876:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:0.0:1787791153.502891:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3391e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18758:x1874634250288256:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.502997:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.503021:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.503039:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506633:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506808:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506822:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506872:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506883:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506889:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791153.506945:0:24230:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787791153.506950:0:24230:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791153.506966:0:24230:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506978:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506985:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506992:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.506998:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.507002:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507010:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507022:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc36fe300) 00010000:00010000:0.0:1787791153.507032:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791153.507038:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507044:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fb44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507061:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507067:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507073:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507078:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9f800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.507081:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507087:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507094:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9170c35dbc00) 00010000:00010000:0.0:1787791153.507097:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791153.507099:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507105:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fb4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507119:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507132:0:24230:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507138:0:24230:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507143:0:24230:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.507146:0:24230:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507153:0:24230:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507160:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:0.0:1787791153.507162:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791153.507165:0:24230:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.507170:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb52 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.507284:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3391e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18758:x1874634250288256:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 4392us (4694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.507294:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:2.0:1787791153.512407:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.512667:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288512 00000100:00100000:0.0:1787791153.512683:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288512 00000100:00100000:0.0:1787791153.512805:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787791153.512817:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+28:18758:x1874634250288512:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.512838:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791153.512874:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fb59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d927224297 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.512995:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513012:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513026:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791153.513037:0:22701:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787791153.513122:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513131:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513139:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513146:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.513151:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513158:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513170:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:0.0:1787791153.513173:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787791153.513177:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513193:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb60 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513246:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fb59 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224297 expref: 30 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513256:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff916fc36fe300) 00010000:00010000:0.0:1787791153.513259:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787791153.513263:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fb59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224297 expref: 30 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.513272:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ec00, rc 0) 00000100:00100000:0.0:1787791153.513341:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+29:18758:x1874634250288512:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 526us (959us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1787791153.513349:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:2.0:1787791153.521762:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.521871:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288640 00000100:00100000:1.0:1787791153.521884:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288640 00000100:00100000:1.0:1787791153.521968:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:1.0:1787791153.521982:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+29:18758:x1874634250288640:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787791153.522031:0:22702:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787791153.522188:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+29:18758:x1874634250288640:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 208us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.522204:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787791153.543938:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.544056:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250288896 00000100:00100000:0.0:1787791153.544073:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250288896 00000100:00100000:0.0:1787791153.544233:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:0.0:1787791153.544246:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+29:18758:x1874634250288896:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.544268:0:24230:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791153.544290:0:24230:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fb6e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d92722429e expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787791153.545990:0:24230:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:3.0:1787791153.546011:0:24230:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1787791153.546108:0:24230:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:3.0:1787791153.553162:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb75 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.553195:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.553345:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb75 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.553483:0:24230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fb6e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722429e expref: 32 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.553510:0:24230:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb75 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722429e expref: 31 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.553520:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc2535300) 00010000:00010000:3.0:1787791153.553524:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787791153.553527:0:24230:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4538400, rc 0) 00000100:00100000:3.0:1787791153.553615:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+31:18758:x1874634250288896:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 9372us (9708us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1787791153.553625:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:2.0:1787791153.557465:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.559334:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289152 00000100:00100000:0.0:1787791153.559348:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289152 00000100:00100000:0.0:1787791153.559454:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:0.0:1787791153.559465:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+31:18758:x1874634250289152:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.559561:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791153.559588:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538400/0xcf9477fddcf1fb75 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d92722429e expref: 31 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559606:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc2535300) 00010000:00010000:0.0:1787791153.559617:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787791153.559648:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559664:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559674:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559688:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559695:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559723:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559782:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559790:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559796:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559808:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ee00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.559813:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559820:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559830:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:0.0:1787791153.559832:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791153.559836:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559842:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fb83 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559852:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559857:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559863:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559868:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.559872:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559878:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559896:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xc4b4c0ea (ffff9170c35dbc00) 00010000:00010000:0.0:1787791153.559899:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787791153.559902:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.559908:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb8a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xc4b4c0ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.560642:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+30:18758:x1874634250289152:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1174us (3183us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787791153.560653:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:2.0:1787791153.563259:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.563859:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289280 00000100:00100000:1.0:1787791153.563869:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289280 00000100:00100000:1.0:1787791153.563934:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:1.0:1787791153.563945:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+30:18758:x1874634250289280:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787791153.563966:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787791153.564078:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1fb91 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272242a5 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564118:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1fb98 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564132:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1fb98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564160:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1fb98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564343:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995c00/0xcf9477fddcf1fb91 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242a5 expref: 32 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564362:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994600/0xcf9477fddcf1fb98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242a5 expref: 31 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.564370:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:1.0:1787791153.564374:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787791153.564377:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc3994600, rc 0) 00000100:00100000:1.0:1787791153.564495:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+31:18758:x1874634250289280:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 552us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.564503:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:3.0:1787791153.567315:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.569577:0:24230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289536 00000100:00100000:0.0:1787791153.569592:0:24230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289536 00000100:00100000:0.0:1787791153.578938:0:24230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:0.0:1787791153.578965:0:24230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+31:18758:x1874634250289536:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.579055:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.579073:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.579084:0:24230:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787791153.579282:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787791153.579292:0:24230:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702527586456ns, next at 703527584292ns, rc = 0 00000004:00010000:0.0:1787791153.579341:0:24230:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000017fa5f9e reply state 0000000019f7a83c transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.579375:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.579383:0:24230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:0.0:1787791153.579386:0:24230:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787791153.579389:0:24230:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787791153.580066:0:24230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fbdca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+33:18758:x1874634250289536:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 1109us (12756us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1787791153.580075:0:24230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:2.0:1787791153.599194:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.599297:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289664 00000100:00100000:0.0:1787791153.599308:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289664 00000100:00100000:0.0:1787791153.599415:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:0.0:1787791153.599426:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+33:18758:x1874634250289664:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.599454:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791153.599491:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272242ac expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.599810:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 34 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.599826:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 34 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.599847:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:0.0:1787791153.599851:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787791153.599856:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9ee00, rc 0) 00000100:00100000:0.0:1787791153.599925:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+34:18758:x1874634250289664:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 501us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.599946:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787791153.606146:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.606193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.606223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.606260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.606286:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.606312:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289792 00000100:00100000:2.0:1787791153.606321:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289792 00000100:00100000:2.0:1787791153.606404:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290176 00000100:00100000:2.0:1787791153.606408:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290176 00000100:00100000:2.0:1787791153.606428:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290304 00000100:00100000:2.0:1787791153.606431:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290304 00000100:00100000:2.0:1787791153.606468:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787791153.606988:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787791153.607001:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2401:x1874634250290304:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787791153.607081:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2401:x1874634250290304:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 84us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.607090:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787791153.607108:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:1.0:1787791153.607116:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2403:x1874634250289792:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787791153.607310:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:2403:x1874634250289792:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 193us (1184us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1787791153.607330:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00080000:3.0:1787791153.607569:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787791153.607574:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787791153.607587:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290048 00000100:00100000:3.0:1787791153.607593:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290048 00000100:00100000:3.0:1787791153.607917:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:3.0:1787791153.607926:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2401:x1874634250290048:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791153.607965:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2401:x1874634250290048:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 41us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.607971:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:3.0:1787791153.608024:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.608086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.608112:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.608131:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290560 00000100:00100000:3.0:1787791153.608135:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290560 00000100:00100000:3.0:1787791153.608157:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290432 00000100:00100000:3.0:1787791153.608159:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290432 00000100:00100000:3.0:1787791153.608178:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787791153.608183:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2401:x1874634250290560:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791153.608209:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4f452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2401:x1874634250290560:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.608216:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787791153.608227:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:3.0:1787791153.608233:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:2400:x1874634250290432:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791153.608262:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+12:2400:x1874634250290432:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 29us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.608267:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:3.0:1787791153.608312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.608327:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290816 00000100:00100000:3.0:1787791153.608330:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290816 00000100:00100000:3.0:1787791153.608349:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250290688 00000100:00100000:3.0:1787791153.608359:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250290688 00000100:00100000:3.0:1787791153.608378:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787791153.608384:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2401:x1874634250290816:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791153.608421:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc3b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2401:x1874634250290816:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.608428:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787791153.608439:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787791153.608445:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2400:x1874634250290688:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787791153.608467:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170e4d5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ce68e33a-1a74-43fd-9813-d959cabf93bb+5:2400:x1874634250290688:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.608473:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:2.0:1787791153.608977:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2400:x1874634250290176:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787791153.609014:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2400:x1874634250290176:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 2537us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791153.609022:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:0.0:1787791153.609227:0:22693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250289920 00000100:00100000:0.0:1787791153.609233:0:22693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250289920 00000100:00100000:0.0:1787791153.609276:0:22693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787791153.609285:0:22693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:2400:x1874634250289920:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787791153.609315:0:22693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fcaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4f3854a-b6f5-45ea-9618-5bb807c84384+13:2400:x1874634250289920:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 32us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.609323:0:22693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00080000:1.0:1787791153.609621:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787791153.609625:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787791153.609629:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787791153.609632:0:22696:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787791153.624973:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.626084:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291072 00000100:00100000:2.0:1787791153.626096:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291072 00000100:00100000:2.0:1787791153.626168:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:2.0:1787791153.626178:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe4012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+34:18758:x1874634250291072:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787791153.626507:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe4012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+35:18758:x1874634250291072:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 329us (1544us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1787791153.626516:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:0.0:1787791153.633700:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.633847:0:24774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291328 00000100:00100000:3.0:1787791153.633857:0:24774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291328 00000100:00100000:3.0:1787791153.633925:0:24774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:3.0:1787791153.633935:0:24774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+35:18758:x1874634250291328:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787791153.634042:0:24774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+35:18758:x1874634250291328:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 109us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.634050:0:24774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:1.0:1787791153.642168:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.642267:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291456 00000100:00100000:0.0:1787791153.642277:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291456 00000100:00100000:0.0:1787791153.642338:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:0.0:1787791153.642348:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+35:18758:x1874634250291456:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.642365:0:22701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787791153.642388:0:22701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fbad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272242b3 expref: -99 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642486:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642500:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642511:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787791153.642613:0:22701:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787791153.642640:0:22701:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642664:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f800/0xcf9477fddcf1fbad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242b3 expref: 37 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642682:0:22701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242b3 expref: 36 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.642691:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:0.0:1787791153.642694:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787791153.642697:0:22701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fbd9f400, rc 0) 00000100:00100000:3.0:1787791153.643347:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+36:18758:x1874634250291456:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 996us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.643357:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:1.0:1787791153.650248:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.650415:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291584 00000100:00100000:2.0:1787791153.650426:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291584 00000100:00100000:2.0:1787791153.650530:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:2.0:1787791153.650550:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe400f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+6:2403:x1874634250291584:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787791153.650568:0:24827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787791153.650591:0:24827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272242ba expref: -99 pid: 24827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787791153.650621:0:24827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f8732, blocks: 0x0 00010000:00010000:2.0:1787791153.650652:0:24827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=702s v=(0 0) 00010000:00010000:2.0:1787791153.650672:0:24827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787791153.650683:0:24827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 7 pid: 24827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.650737:0:24827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 7 pid: 24827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.650761:0:24827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9170fe15f000, rc 0) 00000100:00100000:2.0:1787791153.650829:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe400f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:2403:x1874634250291584:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 290us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787791153.650837:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787791153.663117:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.663352:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291840 00000100:00100000:2.0:1787791153.663362:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291840 00000100:00100000:0.0:1787791153.663535:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:0.0:1787791153.663558:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe4630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+36:18758:x1874634250291840:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787791153.663684:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe4630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+36:18758:x1874634250291840:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 128us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.663692:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:0.0:1787791153.673511:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.673670:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250291968 00000100:00100000:3.0:1787791153.673680:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250291968 00000100:00100000:3.0:1787791153.673808:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787791153.673827:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+36:18758:x1874634250291968:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787791153.676235:0:22680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:1.0:1787791153.676250:0:22680:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787791153.676302:0:22680:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1787791153.676455:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787791153.676486:0:3638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268214528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787791153.676597:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787791153.676800:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676813:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676829:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676836:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994200 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:0.0:1787791153.676841:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676862:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676879:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:0.0:1787791153.676882:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787791153.676888:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.676896:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994200/0xcf9477fddcf1fa48 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.677272:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+19:18758:x1874634250291968:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 3449us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.677289:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00010000:00010000:2.0:1787791153.677702:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677733:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677738:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677742:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15e800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791153.677744:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677748:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677760:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff916fc36fe800) 00010000:00010000:2.0:1787791153.677769:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791153.677774:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677780:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15e800/0xcf9477fddcf1f9bc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677802:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677808:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.677814:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.678005:0:24207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268214528 00000100:00100000:0.0:1787791153.678013:0:24207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268214528 00000100:00100000:0.0:1787791153.678079:0:24207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787791153.678090:0:24207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1874634268214528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787791153.678227:0:24207:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787791153.678231:0:24207:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787791153.678233:0:24207:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787791153.678235:0:24207:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787791154 -> 1787791154 00002000:00010000:0.0:1787791153.678237:0:24207:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787791153.678278:0:24207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe462940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874634268214528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 191us (1684us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787791153.678284:0:24207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1787791153.678469:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9170fe462580/2, rc 0, transno 12884901892 00000100:00100000:3.0:1787791153.678479:0:3638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe462580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1874634268214528:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1787791153.680914:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15fe00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791153.680928:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.680947:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.680976:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff916fc36fec00) 00010000:00010000:2.0:1787791153.680979:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791153.680983:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.680990:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15fe00/0xcf9477fddcf1f9c3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681016:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681210:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681223:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681234:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791153.681237:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681358:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681391:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff916fc268fe00) 00010000:00010000:2.0:1787791153.681439:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791153.681457:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681465:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994800/0xcf9477fddcf1faa3 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681490:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681496:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681500:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681505:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4539c00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791153.681516:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681522:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681530:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:2.0:1787791153.681533:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787791153.681535:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681540:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539c00/0xcf9477fddcf1fb28 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681551:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681557:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681561:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681566:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ea00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:2.0:1787791153.681568:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681573:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.681580:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:2.0:1787791153.681582:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787791153.681594:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.682312:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ea00/0xcf9477fddcf1fb9f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24230 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.684058:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.684174:0:25087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292096 00000100:00100000:3.0:1787791153.684184:0:25087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292096 00000100:00100000:3.0:1787791153.684275:0:25087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:3.0:1787791153.684285:0:25087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe403c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:2402:x1874634250292096:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787791153.684384:0:25087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe403c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:2402:x1874634250292096:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.684400:0:25087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:0.0:1787791153.696816:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.696920:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292352 00000100:00100000:3.0:1787791153.696929:0:22701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292352 00000100:00100000:3.0:1787791153.696993:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:3.0:1787791153.697002:0:22701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+15:18758:x1874634250292352:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787791153.697054:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791153.697084:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9f400/0xcf9477fddcf1fbb4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242b3 expref: 15 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.697114:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:3.0:1787791153.697119:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787791153.697167:0:22701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1fbc2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.697180:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.697190:0:22701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787791153.697328:0:22701:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c4b07e5 reply state 000000008ac1c101 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1fbc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.697341:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538200/0xcf9477fddcf1fbc2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.697346:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:3.0:1787791153.697349:0:22701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787791153.697351:0:22701:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787791153.697481:0:22701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:18758:x1874634250292352:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 479us (674us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787791153.697488:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:0.0:1787791153.701458:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787791153.701571:0:24827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292480 00000100:00100000:2.0:1787791153.701581:0:24827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292480 00000100:00100000:2.0:1787791153.701643:0:24827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:2.0:1787791153.701653:0:24827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+7:2402:x1874634250292480:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787791153.701850:0:24827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787791153.701854:0:24827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787791153 00002000:00010000:2.0:1787791153.701856:0:24827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787791153 00002000:00010000:2.0:1787791153.701858:0:24827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787791154 -> 1787791153 00002000:00010000:2.0:1787791153.701860:0:24827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787791153.701926:0:24827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24dad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2402:x1874634250292480:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 274us (480us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1787791153.701934:0:24827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:1.0:1787791153.707831:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.707962:0:24206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292608 00000100:00100000:3.0:1787791153.707972:0:24206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292608 00000100:00100000:3.0:1787791153.708036:0:24206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:3.0:1787791153.708047:0:24206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe400b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2402:x1874634250292608:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787791153.708091:0:24206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708109:0:24206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791153.708114:0:24206:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791153.708137:0:24206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708153:0:24206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708181:0:24206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708190:0:24206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708198:0:24206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708205:0:24206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc4538800 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:3.0:1787791153.708209:0:24206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708218:0:24206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708234:0:24206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.708242:0:24206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461c7831/0xcf9477fddcf1fbc9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.708443:0:24206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe400b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2402:x1874634250292608:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 397us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.708453:0:24206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:3.0:1787791153.715352:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.716082:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292864 00000100:00100000:0.0:1787791153.716093:0:22702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292864 00000100:00100000:0.0:1787791153.716163:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:0.0:1787791153.716192:0:22702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:18758:x1874634250292864:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787791153.716279:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.716294:0:22702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 16 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.716301:0:22702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.716330:0:22702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 16 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.716339:0:22702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 16 pid: 22700 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.716351:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff916fc24dbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268214656:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787791153.716488:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff916fc460ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791153.720677:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff916fc24dbc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268214656:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787791153.720756:0:22702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.723207:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.723459:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250292992 00000100:00100000:1.0:1787791153.723469:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250292992 00010000:00010000:1.0:1787791153.723519:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 17 pid: 22700 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.723622:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:1.0:1787791153.723634:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe4612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+17:2403:x1874634250292992:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787791153.723650:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787791153.723658:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 17 pid: 22700 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723694:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 17 pid: 22700 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723745:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539800/0xcf9477fddcf1fb21 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d927224282 expref: 17 pid: 22700 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723945:0:22686:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791153.723953:0:22686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 16 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723963:0:22686:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723972:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.723980:0:22686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.724125:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787791153.724185:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe4612c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:2403:x1874634250292992:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 552us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.724194:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00010000:00010000:0.0:1787791153.727389:0:22702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.727417:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.727812:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.727832:0:22702:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 16 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.727852:0:22702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.727896:0:22702:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 16 pid: 22701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.727914:0:22702:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 16 pid: 22701 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.727931:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268214784:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787791153.728100:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791153.733337:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268214784:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787791153.733370:0:22702:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.739242:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.739349:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293120 00000100:00100000:0.0:1787791153.739360:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293120 00010000:00010000:0.0:1787791153.739413:0:22685:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 17 pid: 22701 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.739480:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:0.0:1787791153.739491:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe462d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+17:2402:x1874634250293120:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787791153.739510:0:22685:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787791153.739518:0:22685:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 17 pid: 22701 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739531:0:22685:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 17 pid: 22701 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739563:0:22685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ee00/0xcf9477fddcf1fba6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ac expref: 17 pid: 22701 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739582:0:22685:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:0.0:1787791153.739587:0:22685:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739597:0:22685:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739604:0:22685:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.739637:0:22685:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787791153.739744:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe462d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+16:2402:x1874634250293120:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 213us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.739765:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00010000:00010000:1.0:1787791153.739850:0:22702:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.739859:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787791153.739970:0:22702:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1787791153.740173:0:22702:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1787791153.740224:0:22702:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1787791153.740307:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22702:1874634268214912:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787791153.740359:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791153.740404:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170face4480 going to sleep for 11 seconds 00000100:00100000:0.0:1787791153.741504:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268214912 00000100:00100000:0.0:1787791153.741522:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268214912 00000100:00100000:0.0:1787791153.741581:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787791153.741591:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe4003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22702:x1874634268214912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787791153.741700:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe4003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22702:x1874634268214912:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787791153.741739:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787791153.741900:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22702:1874634268214912:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787791153.742075:0:22702:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787791153.742138:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22702:1874634268215040:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787791153.742175:0:22702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787791153.742202:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787791153.742258:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634268215040 00000100:00100000:3.0:1787791153.742263:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634268215040 00000100:00100000:3.0:1787791153.742286:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787791153.742293:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22702:x1874634268215040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787791153.742417:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22702:x1874634268215040:12345-0@lo:1000:mdt00_002.0 Request processed in 123us (241us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787791153.742424:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787791153.742570:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe401e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22702:1874634268215040:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787791153.742619:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742629:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742642:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742652:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994400 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791153.742657:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742671:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742692:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:1.0:1787791153.742698:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787791153.742728:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742741:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994400/0xcf9477fddcf1fbd7 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742790:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742808:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742815:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742825:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fe15f800 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791153.742828:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742837:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742849:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791153.742855:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787791153.742861:0:22702:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 19 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742878:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 19 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742894:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 19 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.742969:0:22702:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994c00/0xcf9477fddcf1fb3d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d927224290 expref: 19 pid: 24774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.742982:0:22702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe403840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268215168:192.168.202.22@tcp:105: 00000100:00100000:1.0:1787791153.743066:0:22702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170fbe82cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787791153.747757:0:22702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe403840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22702:1874634268215168:192.168.202.22@tcp:105: 00010000:00010000:1.0:1787791153.747802:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747814:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fe15f800/0xcf9477fddcf1fb36 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22701 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747853:0:22702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747867:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747878:0:22702:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747888:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747894:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747901:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747907:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791153.747910:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747917:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747947:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791153.747949:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787791153.747952:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747956:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3994e00/0xcf9477fddcf1fbde lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747964:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747968:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747974:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747980:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9170fbd9ec00 already unused, calling callback (ffffffffc17d14f0) 00010000:00010000:1.0:1787791153.747983:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747989:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.747997:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:1.0:1787791153.748000:0:22702:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787791153.748003:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.748009:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9170fbd9ec00/0xcf9477fddcf1fbd0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22702 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.748161:0:22702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+19:18758:x1874634250292864:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 31971us (32821us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787791153.748170:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000020:00080000:1.0:1787791153.748176:0:22702:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787791153.748541:0:22736:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787791153.748545:0:22736:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787791153.748570:0:22736:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787791153.748574:0:22736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1787791153.755228:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.755274:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.755337:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293248 00000100:00100000:1.0:1787791153.755347:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293248 00000100:00100000:1.0:1787791153.755388:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293504 00000100:00100000:1.0:1787791153.755401:0:22703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293504 00000100:00100000:1.0:1787791153.755422:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787791153.755432:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe1be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+20:18757:x1874634250293248:12345-192.168.202.22@tcp:49:dd.0 00000100:00100000:1.0:1787791153.755578:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe1be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+20:18757:x1874634250293248:12345-192.168.202.22@tcp:49:dd.0 Request processed in 141us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787791153.755587:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787791153.755632:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787791153.755640:0:22703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+19:18758:x1874634250293504:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787791153.755903:0:22703:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787791153.755936:0:22703:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1787791153.755971:0:22703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.755989:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756002:0:22703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756011:0:22703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756031:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756037:0:22703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756055:0:22703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787791153.756113:0:22703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18758:x1874634250293504:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 472us (837us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1787791153.756120:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000020:00080000:1.0:1787791153.756124:0:22703:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787791153.756142:0:22689:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787791153.756148:0:22689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756157:0:22689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:1.0:1787791153.756161:0:22689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756167:0:22689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756177:0:22689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff916fc268fc00) 00010000:00010000:1.0:1787791153.756179:0:22689:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787791153.756183:0:22689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756187:0:22689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc3995200/0xcf9477fddcf1fbe5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22703 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.756204:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791153.756205:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791153.756207:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787791153.760139:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787791153.760224:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293632 00000100:00100000:3.0:1787791153.760235:0:22700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293632 00000100:00100000:3.0:1787791153.760306:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:3.0:1787791153.760318:0:22700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+21:18757:x1874634250293632:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787791153.760339:0:22700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787791153.760359:0:22700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538800/0xcf9477fddcf1fbec lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd536f2d9272242c1 expref: -99 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760404:0:22700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1fbf3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760419:0:22700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1fbf3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760448:0:22700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1fbf3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760563:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4538800/0xcf9477fddcf1fbec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242c1 expref: 23 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760581:0:22700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff916fc4539e00/0xcf9477fddcf1fbf3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242c1 expref: 22 pid: 22700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.760589:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff916fc268f700) 00010000:00010000:3.0:1787791153.760592:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787791153.760596:0:22700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff916fc4539e00, rc 0) 00000100:00100000:3.0:1787791153.760698:0:22700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc1cd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+22:18757:x1874634250293632:12345-192.168.202.22@tcp:101:dd.0 Request processed in 382us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.760738:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:0.0:1787791153.804522:0:3631:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.804689:0:24211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293760 00000100:00100000:1.0:1787791153.804700:0:24211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293760 00000100:00100000:1.0:1787791153.804833:0:24211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787791153.804844:0:24211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff916fc24da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2403:x1874634250293760:12345-192.168.202.22@tcp:4:dd.0 00010000:00010000:1.0:1787791153.804882:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.804903:0:24211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 8 pid: 24827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.804913:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791153.804918:0:24211:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791153.804922:0:24211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.804962:0:24211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 8 pid: 24827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.804979:0:24211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 8 pid: 24827 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787791153.804995:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9170fe4012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24211:1874634268215296:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787791153.805098:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9170c2ba8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787791153.808777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787791153.808954:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9170fe4012c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24211:1874634268215296:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787791153.808991:0:24211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.811494:0:22686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250294016 00000100:00100000:3.0:1787791153.811506:0:22686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250294016 00010000:00010000:3.0:1787791153.811548:0:22686:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 9 pid: 24827 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.811594:0:22686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787791153.811603:0:22686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe403840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:2403:x1874634250294016:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787791153.811619:0:22686:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787791153.811639:0:22686:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 9 pid: 24827 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.811672:0:22686:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 9 pid: 24827 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.811695:0:22686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b0be82b/0xcf9477fddcf1fbbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0xd536f2d9272242ba expref: 9 pid: 24827 timeout: 802 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.811731:0:22686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791153.811782:0:22686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787791153.811788:0:22686:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.811798:0:22686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787791153.811832:0:22686:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787791153.811885:0:22686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe403840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2403:x1874634250294016:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 283us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787791153.811892:0:22686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00010000:00010000:2.0:1787791153.811980:0:24211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.811991:0:24211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787791153.816111:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787791153.816382:0:24213:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787791153.816400:0:24213:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787791153.816784:0:24213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874634250293888 00000100:00100000:0.0:1787791153.816794:0:24213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874634250293888 00000100:00100000:1.0:1787791153.817315:0:25747:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:1.0:1787791153.817327:0:25747:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9170fe460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+8:2403:x1874634250293888:12345-192.168.202.22@tcp:4:dd.0 00010000:00010000:1.0:1787791153.817357:0:25747:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.817372:0:25747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791153.817376:0:25747:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787791153.817380:0:25747:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787791153.817401:0:25747:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787791153.926260:0:24202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:1.0:1787791153.926285:0:24202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1787791153.927056:0:24211:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1787791153.927065:0:24211:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1787791153 -> 1787791155 00002000:00010000:0.0:1787791153.927068:0:24211:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787791153 -> 1787791155 00002000:00010000:0.0:1787791153.927070:0:24211:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1787791153.927093:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927110:0:24211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927137:0:24211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927145:0:24211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3995200 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:0.0:1787791153.927151:0:24211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927163:0:24211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927189:0:24211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787791153.927198:0:24211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055a5dbd1/0xcf9477fddcf1fbfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787791153.927355:0:24211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff916fc24da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+9:2403:x1874634250293760:12345-192.168.202.22@tcp:4:dd.0 Request processed in 122505us (122838us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1787791153.927374:0:24211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000001:00080000:1.0:1787791153.929070:0:24202:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00010000:00010000:2.0:1787791153.930884:0:25747:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930935:0:25747:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930944:0:25747:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930951:0:25747:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff916fc3994e00 already unused, calling callback (ffffffffc0bbe420) 00010000:00010000:2.0:1787791153.930957:0:25747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930967:0:25747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930990:0:25747:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787791153.930998:0:25747:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001897f1d1/0xcf9477fddcf1fc01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25747 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787791153.931696:0:25747:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9170fe460f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bd3b2ccd-1632-4ec7-bd48-84a904f4451a+5:2403:x1874634250293888:12345-192.168.202.22@tcp:4:dd.0 Request processed in 114359us (115590us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1787791153.931748:0:25747:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00010000:00010000:1.0:1787791154.061349:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787791154.251363:0:23454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787791155.084154:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787791155.723926:0:25784:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787791156.106893:0:22688:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787791157.131701:0:22689:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13975 lines, 13975 kept, 0 dropped, 0 bad.