00010000:00010000:1.0F:1788460616.716469:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1788460617.318963:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788460617.318994:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9650c571c3c0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1788460617.318999:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fd1e7800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9650c571cf00 00000020:00080000:2.0:1788460617.319003:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9650fd1e7e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff964fc30c5400 00000020:00080000:1.0:1788460617.319144:0:14539:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1788460617.319380:0:14539:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1788460617.742327:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1788460618.252997:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460618.253034:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482634624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460618.253101:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460618.253193:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634624 00000100:00100000:0.0:1788460618.253200:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634624 00000100:00100000:0.0:1788460618.253266:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460618.253276:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482634624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460618.253310:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788460618.253354:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482634624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460618.253361:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788460618.253382:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460618.253418:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482634624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460618.254368:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482635136:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.254418:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460618.254451:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788460618.254457:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482634752:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.254488:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460618.254512:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482635264:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.254911:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460618.254945:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482634880:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.254968:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460618.254989:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460618.254995:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482635008:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.255015:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460618.255044:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635136 00000100:00100000:2.0:1788460618.255050:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635136 00000100:00100000:2.0:1788460618.255096:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635264 00000100:00100000:2.0:1788460618.255099:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635264 00000100:00100000:2.0:1788460618.255114:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635008 00000100:00100000:2.0:1788460618.255116:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635008 00000100:00100000:2.0:1788460618.255333:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460618.255344:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482635136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.255393:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482635136:12345-0@lo:400:kworker.0 Request processed in 52us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460618.255400:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460618.255433:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460618.255440:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482635264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.255470:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482635264:12345-0@lo:400:kworker.0 Request processed in 31us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460618.255476:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460618.255488:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460618.255494:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482635008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460618.256157:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634752 00000100:00100000:0.0:1788460618.256166:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634752 00000100:00100000:0.0:1788460618.256220:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788460618.256228:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3318:x1875336482634752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460618.256287:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3318:x1875336482634752:12345-0@lo:400:kworker.0 Request processed in 59us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460618.256293:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1788460618.256323:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460618.256624:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482635008:12345-0@lo:400:kworker.0 Request processed in 1128us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460618.256633:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460618.256662:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482634880 00000100:00100000:2.0:1788460618.256666:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482634880 00000100:00100000:3.0:1788460618.257455:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482635008:0@lo:400:kworker.0 00000100:00080000:0.0:1788460618.257763:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460618.257851:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460618.257862:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482634880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.257935:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482634880:12345-0@lo:400:kworker.0 Request processed in 75us (2965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460618.257942:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460618.257972:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482634752:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.257985:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5005f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482635264:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.257999:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482635136:0@lo:400:kworker.0 00000100:00100000:2.0:1788460618.258117:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482634880:0@lo:400:kworker.0 00010000:00010000:0.0:1788460618.771552:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460619.171262:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460619.171401:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462727808 00000100:00100000:2.0:1788460619.171411:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462727808 00000100:00100000:2.0:1788460619.171486:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460619.171497:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:14476:x1875336462727808:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788460619.171628:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:14476:x1875336462727808:12345-192.168.203.32@tcp:60:lhsmtool_posix.0 Request processed in 133us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460619.171637:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00080000:0.0:1788460619.171712:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460619.173075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460619.173209:0:14504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728064 00000100:00100000:1.0:1788460619.173217:0:14504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728064 00000100:00100000:1.0:1788460619.173279:0:14504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460619.173288:0:14504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:14476:x1875336462728064:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788460619.173528:0:14504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+13:14476:x1875336462728064:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 239us (457us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788460619.173536:0:14504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:2.0:1788460619.276853:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460619.276876:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482635392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460619.276940:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460619.277063:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635392 00000100:00100000:3.0:1788460619.277072:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635392 00000100:00100000:3.0:1788460619.277130:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460619.277139:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482635392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460619.277173:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460619.277258:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482635392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460619.277265:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460619.277372:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482635392:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460619.791372:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460620.812345:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460621.047936:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.047978:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048011:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048072:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460621.048125:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728320 00000100:00100000:3.0:1788460621.048133:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728320 00000100:00100000:3.0:1788460621.048213:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728704 00000100:00100000:3.0:1788460621.048216:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728704 00000100:00100000:3.0:1788460621.048244:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460621.048254:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+13:2380:x1875336462728320:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460621.048323:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+13:2380:x1875336462728320:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.048330:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460621.048358:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1788460621.048364:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2380:x1875336462728704:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460621.048385:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2380:x1875336462728704:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.048391:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:3.0:1788460621.048405:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728576 00000100:00100000:3.0:1788460621.048408:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728576 00000100:00100000:3.0:1788460621.048423:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728448 00000100:00100000:3.0:1788460621.048425:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728448 00000100:00100000:3.0:1788460621.048434:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728832 00000100:00100000:3.0:1788460621.048436:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728832 00000100:00100000:3.0:1788460621.048446:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728960 00000100:00100000:3.0:1788460621.048447:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728960 00000100:00100000:3.0:1788460621.048458:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1788460621.048464:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462728576:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460621.048483:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462728576:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 20us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.048489:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:3.0:1788460621.048498:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460621.048503:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2378:x1875336462728448:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1788460621.048522:0:15184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8607 00000100:00080000:3.0:1788460621.048538:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650c2e44000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460621.048570:0:15184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788460621.048787:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+2:2378:x1875336462728448:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 283us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.048793:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460621.048804:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1788460621.048816:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2378:x1875336462728832:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1788460621.048827:0:15184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8646 00000100:00080000:3.0:1788460621.048831:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460621.048848:0:15184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788460621.048919:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+2:2378:x1875336462728832:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 103us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.048925:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1788460621.048936:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460621.048941:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2378:x1875336462728960:12345-192.168.203.32@tcp:9:kworker.0 00000020:00000080:3.0:1788460621.048950:0:15184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b864d 00000100:00080000:3.0:1788460621.048956:0:15184:0:(import.c:65:import_set_state_nolock()) ffff9650fc7a6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460621.048968:0:15184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788460621.049082:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cc6eb25b-f5fb-4afa-a165-3499bc737f69+2:2378:x1875336462728960:12345-192.168.203.32@tcp:9:kworker.0 Request processed in 140us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460621.049088:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00080000:3.0:1788460621.049106:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460621.049110:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460621.049112:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460621.049120:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460621.050449:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460621.051634:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462728192 00000100:00100000:2.0:1788460621.051647:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462728192 00000100:00100000:2.0:1788460621.051720:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 145 00000100:00100000:2.0:1788460621.051731:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2380:x1875336462728192:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460621.051820:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2380:x1875336462728192:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 92us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460621.051828:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 145 00000040:00080000:3.0:1788460621.580725:0:14535:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460621.580736:0:14535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460621.580772:0:14535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788460621.580783:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788460621.836649:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788460622.447498:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788460622.447516:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:0.0:1788460622.447697:0:14539:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:0.0:1788460622.447709:0:14539:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:0.0:1788460622.860300:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460623.376829:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482635904:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.376899:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.376962:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788460623.376969:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482635520:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377001:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.377023:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482636032:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377044:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.377068:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377159:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.377208:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788460623.377223:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482635648:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377246:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.377264:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482636160:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377284:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460623.377314:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635520 00000100:00100000:1.0:1788460623.377321:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635520 00000100:00100000:1.0:1788460623.377366:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460623.377388:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482635520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377436:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482635520:12345-0@lo:400:kworker.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.377443:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460623.377486:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635776 00000100:00100000:1.0:1788460623.377489:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635776 00000100:00100000:1.0:1788460623.377521:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635648 00000100:00100000:1.0:1788460623.377523:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635648 00000100:00100000:1.0:1788460623.377543:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460623.377549:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482635776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377584:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482635776:12345-0@lo:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.377591:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460623.377602:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460623.377607:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482635648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.377633:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482635648:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.379382:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460623.379435:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482635904 00000100:00100000:1.0:1788460623.379443:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482635904 00000100:00100000:1.0:1788460623.379490:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636032 00000100:00100000:1.0:1788460623.379493:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636032 00000100:00100000:1.0:1788460623.379506:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636160 00000100:00100000:1.0:1788460623.379508:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636160 00000100:00100000:1.0:1788460623.379524:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460623.379533:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482635904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.379605:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482635904:12345-0@lo:400:kworker.0 Request processed in 74us (2706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.379623:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460623.379861:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788460623.379872:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482636032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.379905:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482636032:12345-0@lo:400:kworker.0 Request processed in 36us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.379911:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788460623.379923:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788460623.379930:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482636160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.379955:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482636160:12345-0@lo:400:kworker.0 Request processed in 27us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460623.379962:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788460623.380016:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482635648:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.380028:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482636160:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.380039:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482635776:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.380070:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482635520:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.380081:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482636032:0@lo:400:kworker.0 00000100:00100000:1.0:1788460623.380157:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482635904:0@lo:400:kworker.0 00000100:00080000:3.0:1788460623.380727:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460623.380733:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460623.380735:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460623.380803:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482636288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460623.380846:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460623.383425:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636288 00000100:00100000:0.0:1788460623.383441:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636288 00000100:00100000:0.0:1788460623.383486:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460623.383494:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482636288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460623.383529:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788460623.383596:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482636288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (2749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460623.383602:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460623.383657:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482636288:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788460623.456174:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000020:00000080:1.0:1788460623.456196:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650fc7a6800/cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000020:00000080:1.0:1788460623.456245:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fc7a6800/cc6eb25b-f5fb-4afa-a165-3499bc737f69 for lustre-OST0001 00000020:00000080:1.0:1788460623.456292:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fc7a6000 for lustre-OST0001 00010000:00010000:1.0:1788460623.886274:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460624.400361:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482636416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460624.400429:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460624.400511:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636416 00000100:00100000:1.0:1788460624.400520:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636416 00000100:00100000:1.0:1788460624.400572:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460624.400581:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482636416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460624.400620:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460624.400664:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482636416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460624.400672:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460624.400716:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482636416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460624.908333:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788460624.994251:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000020:00000080:3.0:1788460624.994268:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650fc7a0000/cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000001:00100000:3.0:1788460624.994292:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000020:00000080:3.0:1788460624.994294:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650c2e42800/6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000020:00000080:1.0:1788460624.997484:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fc7a0000/cc6eb25b-f5fb-4afa-a165-3499bc737f69 for lustre-OST0000 00000020:00000080:1.0:1788460624.997559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c2e42800/6e4fcceb-7a26-44ed-a31b-b309e7102e93 for lustre-OST0000 00000020:00000080:1.0:1788460624.997580:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fc7a3000 for lustre-OST0000 00000020:00000080:1.0:1788460624.997585:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c2e44000 for lustre-OST0000 00010000:00010000:0.0:1788460625.933352:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460626.163419:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460626.163529:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460626.164051:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729216 00000100:00100000:1.0:1788460626.164061:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729216 00000100:00100000:1.0:1788460626.164148:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1788460626.164160:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:2382:x1875336462729216:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460626.164271:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:2382:x1875336462729216:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 114us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460626.164279:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00080000:3.0:1788460626.164741:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460626.174461:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729088 00000100:00100000:2.0:1788460626.174478:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729088 00000100:00100000:2.0:1788460626.176816:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:2.0:1788460626.176842:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2381:x1875336462729088:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460626.176934:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2381:x1875336462729088:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 104us (13523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460626.176943:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 147 00000100:00100000:3.0:1788460626.179658:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460626.179745:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460626.180019:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729472 00000100:00100000:0.0:1788460626.180029:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729472 00000100:00100000:0.0:1788460626.180105:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:0.0:1788460626.180116:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2382:x1875336462729472:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460626.180238:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2382:x1875336462729472:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 124us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460626.180245:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00080000:3.0:1788460626.180787:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460626.184012:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729344 00000100:00100000:1.0:1788460626.184027:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729344 00000100:00100000:1.0:1788460626.185316:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:1.0:1788460626.185342:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462729344:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460626.185476:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2382:x1875336462729344:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 137us (5729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460626.185486:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00080000:3.0:1788460626.188939:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788460626.959339:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460627.980490:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460628.492522:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482636544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460628.492561:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482636800:0@lo:400:kworker.0 00000100:00100000:3.0:1788460628.492588:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460628.492591:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460628.492654:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636800 00000100:00100000:0.0:1788460628.492663:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636800 00000100:00100000:0.0:1788460628.492722:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460628.492732:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482636800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788460628.498378:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460628.498407:0:15188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636544 00000100:00100000:2.0:1788460628.498433:0:15188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636544 00000100:00100000:2.0:1788460628.498518:0:15188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460628.498529:0:15188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482636544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460628.498568:0:15188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788460628.500576:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482637312:0@lo:400:kworker.0 00000100:00100000:0.0:1788460628.500638:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482636800:12345-0@lo:400:kworker.0 Request processed in 7905us (8041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460628.500650:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460628.500731:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460628.500759:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637312 00000100:00100000:1.0:1788460628.500766:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637312 00000100:00100000:1.0:1788460628.500809:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460628.500817:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482637312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.501017:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875336482637312:12345-0@lo:400:kworker.0 Request processed in 199us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460628.501024:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460628.501068:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3319:1875336482637312:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.501098:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482636800:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.501106:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788460628.501112:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482636672:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.501138:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460628.501159:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636672 00000100:00100000:1.0:1788460628.501163:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636672 00000100:00100000:1.0:1788460628.501213:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460628.501220:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3319:x1875336482636672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460628.503125:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482637184:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.503385:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3319:x1875336482636672:12345-0@lo:400:kworker.0 Request processed in 2163us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460628.503405:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460628.503491:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482636928:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.503525:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460628.503555:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460628.503562:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482637056:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.503584:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460628.503690:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482636928 00000100:00100000:1.0:1788460628.503698:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482636928 00000100:00100000:1.0:1788460628.503734:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460628.503742:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fe01d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482636928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.503787:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fe01d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1875336482636928:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460628.503794:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788460628.503931:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637056 00000100:00100000:1.0:1788460628.503935:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637056 00000100:00100000:1.0:1788460628.503960:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788460628.503966:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482637056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.503998:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482637056:12345-0@lo:400:kworker.0 Request processed in 32us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460628.504004:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788460628.504037:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482637056:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.504046:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482636928:0@lo:400:kworker.0 00000100:00080000:1.0:1788460628.504067:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460628.504073:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460628.505001:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460628.505049:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637184 00000100:00100000:0.0:1788460628.505055:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637184 00000100:00100000:0.0:1788460628.505099:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788460628.505106:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482637184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460628.505152:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875336482637184:12345-0@lo:400:kworker.0 Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00080000:1.0:1788460628.505311:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460628.505411:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460628.505452:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482637184:0@lo:400:kworker.0 00000100:00100000:1.0:1788460628.505475:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482636672:0@lo:400:kworker.0 00000100:00100000:2.0:1788460628.508032:0:15188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482636544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9498us (15436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460628.508046:0:15188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460628.508112:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482636544:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788460629.005831:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460629.516509:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460629.516534:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482637440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460629.516612:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460629.516837:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637440 00000100:00100000:1.0:1788460629.516844:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637440 00000100:00100000:1.0:1788460629.516893:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460629.516903:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482637440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460629.516937:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460629.516988:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482637440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460629.516995:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460629.517077:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482637440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460630.028400:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460630.556671:0:17433:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:37:08 (1788460628) 00010000:00010000:0.0:1788460631.053078:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460631.272720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460631.272775:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460631.272809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460631.272842:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460631.272929:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729728 00000100:00100000:1.0:1788460631.272938:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729728 00000100:00100000:1.0:1788460631.273010:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729984 00000100:00100000:1.0:1788460631.273014:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729984 00000100:00100000:1.0:1788460631.273038:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:1.0:1788460631.273047:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:2380:x1875336462729728:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460631.273133:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:2380:x1875336462729728:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460631.273141:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:1.0:1788460631.273171:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00080000:3.0:1788460631.273279:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460631.273341:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729856 00000100:00100000:0.0:1788460631.273347:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729856 00000100:00100000:0.0:1788460631.273398:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:0.0:1788460631.273406:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462729856:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460631.273438:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2380:x1875336462729856:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460631.273445:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00080000:3.0:1788460631.273564:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460631.273625:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2380:x1875336462729984:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460631.273656:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2380:x1875336462729984:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 478us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460631.273663:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:2.0:1788460631.273880:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462729600 00000100:00100000:2.0:1788460631.273885:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462729600 00000100:00100000:2.0:1788460631.273922:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 149 00000100:00100000:2.0:1788460631.273929:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2380:x1875336462729600:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460631.273965:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2380:x1875336462729600:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460631.273971:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 149 00000040:00080000:3.0:1788460631.820555:0:14535:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460631.820564:0:14535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460631.820601:0:14535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788460631.820612:0:14535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788460632.076870:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460633.101003:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460633.612363:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482637568:0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.612399:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482637952:0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.612509:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482637696:0@lo:400:kworker.0 00000100:00100000:3.0:1788460633.612879:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482637824:0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.613974:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460633.614038:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460633.614048:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482638080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.614079:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460633.614115:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637952 00000100:00100000:1.0:1788460633.614122:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637952 00000100:00100000:1.0:1788460633.616900:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638080 00000100:00100000:1.0:1788460633.616913:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638080 00000100:00100000:1.0:1788460633.616967:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788460633.616979:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482637952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.617064:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482637952:12345-0@lo:400:kworker.0 Request processed in 89us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460633.617071:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788460633.617090:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460633.617096:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482638080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.617126:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482638080:12345-0@lo:400:kworker.0 Request processed in 31us (3046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460633.617132:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460633.617976:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482638080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460633.617991:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482637952:0@lo:400:kworker.0 00000100:00080000:1.0:1788460633.618038:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460633.624112:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460633.624205:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482638208:0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.624238:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460633.624265:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638208 00000100:00100000:0.0:1788460633.624273:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638208 00000100:00100000:0.0:1788460633.624330:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788460633.624338:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482638208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.624387:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482638208:12345-0@lo:400:kworker.0 Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460633.624395:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788460633.624417:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460633.624446:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482638208:0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.624531:0:16370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637696 00000100:00100000:0.0:1788460633.624536:0:16370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637696 00000100:00100000:0.0:1788460633.624568:0:16370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460633.624576:0:16370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482637696:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788460633.624606:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460633.624616:0:16370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482637696:12345-0@lo:400:kworker.0 Request processed in 41us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460633.624625:0:16370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460633.624646:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482637696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460633.625099:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460633.625261:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637568 00000100:00100000:0.0:1788460633.625266:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637568 00000100:00100000:0.0:1788460633.625300:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788460633.625308:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3317:x1875336482637568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.625348:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+23:3317:x1875336482637568:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460633.625354:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788460633.625450:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482637568:0@lo:400:kworker.0 00000100:00100000:3.0:1788460633.625624:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460633.626323:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482638336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460633.626369:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460633.627877:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638336 00000100:00100000:2.0:1788460633.627889:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638336 00000100:00100000:2.0:1788460633.627978:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460633.627990:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482638336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460633.628027:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788460633.628107:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482638336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460633.628129:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788460633.628283:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460633.630125:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482638336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460633.634476:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482637824 00000100:00100000:0.0:1788460633.634491:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482637824 00000100:00100000:0.0:1788460633.634615:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788460633.634626:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482637824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460633.634736:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482637824:12345-0@lo:400:kworker.0 Request processed in 112us (9112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460633.634743:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788460633.634828:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482637824:0@lo:400:kworker.0 00010000:00010000:0.0:1788460634.124895:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460634.639687:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460634.639711:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482638464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460634.639779:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460634.641123:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638464 00000100:00100000:1.0:1788460634.641143:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638464 00000100:00100000:1.0:1788460634.641249:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460634.641258:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482638464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460634.641311:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460634.641388:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482638464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460634.641398:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460634.641668:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482638464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460635.148341:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460635.339088:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460635.339214:0:14505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730240 00000100:00100000:0.0:1788460635.339224:0:14505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730240 00000100:00100000:0.0:1788460635.339304:0:14505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460635.339317:0:14505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+12:15361:x1875336462730240:12345-192.168.203.32@tcp:35:umount.0 00000001:00080000:0.0:1788460635.339661:0:14505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788460635.339765:0:14505:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788460635.339916:0:14505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4fcceb-7a26-44ed-a31b-b309e7102e93+15:15361:x1875336462730240:12345-192.168.203.32@tcp:35:umount.0 Request processed in 600us (837us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788460635.339926:0:14505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000020:00080000:0.0:1788460635.339931:0:14505:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:1.0:1788460635.340092:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460635.358230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460635.358268:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460635.358293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460635.358315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460635.358453:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730368 00000100:00100000:1.0:1788460635.358463:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730368 00000100:00100000:1.0:1788460635.358509:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730624 00000100:00100000:1.0:1788460635.358513:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730624 00000100:00100000:1.0:1788460635.358523:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730496 00000100:00100000:1.0:1788460635.358526:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730496 00000100:00100000:1.0:1788460635.358535:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730752 00000100:00100000:1.0:1788460635.358537:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730752 00000100:00100000:1.0:1788460635.358554:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460635.358563:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+17:2380:x1875336462730368:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460635.358576:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460635.358595:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009e00/0x889bb893541b85eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1653 expref: 17 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460635.358613:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460635.358676:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+16:2380:x1875336462730368:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 112us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460635.358683:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460635.358707:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460635.358727:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+15:2380:x1875336462730624:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460635.358735:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460635.358744:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029de00/0x889bb893541b8670 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1725 expref: 15 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460635.358754:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460635.358773:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+14:2380:x1875336462730624:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 48us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460635.358784:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460635.358797:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460635.358803:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:2380:x1875336462730496:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460635.358811:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460635.358819:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009a00/0x889bb893541b85f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d167d expref: 13 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460635.358827:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460635.358857:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:2380:x1875336462730496:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 54us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460635.358864:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460635.358875:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460635.358881:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:2380:x1875336462730752:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460635.358887:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460635.358895:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea4600/0x889bb893541b85e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d164c expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460635.358902:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460635.358923:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:2380:x1875336462730752:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 43us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460635.358930:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460635.365614:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460635.365706:0:15187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462730880 00000100:00100000:1.0:1788460635.365717:0:15187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462730880 00000100:00100000:1.0:1788460635.365789:0:15187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:1.0:1788460635.365800:0:15187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+5:2378:x1875336462730880:12345-192.168.203.32@tcp:9:umount.0 00000020:00000080:1.0:1788460635.365853:0:15187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b860e 00000100:00080000:1.0:1788460635.365867:0:15187:0:(import.c:65:import_set_state_nolock()) ffff9650c2e42000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460635.365911:0:15187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788460635.366231:0:15187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4fcceb-7a26-44ed-a31b-b309e7102e93+2:2378:x1875336462730880:12345-192.168.203.32@tcp:9:umount.0 Request processed in 431us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460635.366239:0:15187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00010000:00010000:3.0:1788460635.366428:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460635.366710:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460635.388297:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460635.392737:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462731776 00000100:00100000:1.0:1788460635.392751:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462731776 00000100:00100000:1.0:1788460635.392835:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:1.0:1788460635.392857:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+15:2378:x1875336462731776:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:1.0:1788460635.392890:0:14501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8600 00000020:00010000:1.0:1788460635.392911:0:14501:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9650c2e47800: total 0 00000100:00080000:1.0:1788460635.392916:0:14501:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460635.392940:0:14501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1788460635.393383:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4fcceb-7a26-44ed-a31b-b309e7102e93+14:2378:x1875336462731776:12345-192.168.203.32@tcp:39:umount.0 Request processed in 527us (5096us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788460635.393393:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000020:00010000:0.0:1788460635.395579:0:14491:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9650c2e47800: total 0 00010000:00010000:0.0:1788460635.395638:0:14491:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9650c2e47800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788460635.395670:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460635.395673:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460635.395685:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec008600/0x889bb893541b880d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1795 expref: 13 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395725:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9650c3cb0e00) 00010000:00010000:0.0:1788460635.395728:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460635.395732:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650ec009800/0x889bb893541b8830 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17a3 expref: 12 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395749:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650c7412d00) 00010000:00010000:0.0:1788460635.395752:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460635.395755:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5600/0x889bb893541b86d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1733 expref: 11 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395770:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:0.0:1788460635.395772:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460635.395776:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4e00/0x889bb893541b870a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1741 expref: 10 pid: 14501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395790:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9650c52edb00) 00010000:00010000:0.0:1788460635.395792:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460635.395796:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5000/0x889bb893541b888b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17b8 expref: 9 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395810:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650e70d8700) 00010000:00010000:0.0:1788460635.395813:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460635.395817:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4800/0x889bb893541b86b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d172c expref: 8 pid: 14502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395830:0:14491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9650c52edc00) 00010000:00010000:0.0:1788460635.395833:0:14491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788460635.395853:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f5400/0x889bb893541b878f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d176b expref: 7 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460635.395868:0:14491:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9650c2e47800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788460635.395881:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460635.395882:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460635.395884:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460636.172420:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460636.397358:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460636.397470:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460636.397835:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732032 00000100:00100000:1.0:1788460636.397846:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732032 00000100:00080000:3.0:1788460636.397925:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460636.397931:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:1.0:1788460636.397957:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2379:x1875336462732032:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460636.398047:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2379:x1875336462732032:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 92us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460636.398080:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462731904 00000100:00100000:2.0:1788460636.398085:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462731904 00000100:00100000:2.0:1788460636.398154:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:2.0:1788460636.398163:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:2379:x1875336462731904:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460636.398394:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:2379:x1875336462731904:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 79us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460636.398402:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 151 00000100:00100000:1.0:1788460636.398637:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00010000:00010000:0.0:1788460637.201258:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788460637.787962:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000001:00100000:2.0:1788460637.787986:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000001:00080000:2.0:1788460637.788005:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788460637.788009:0:5864:0:(genops.c:885:class_export_put()) final put ffff9650c2e47800/6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000020:00000080:0.0:1788460637.788480:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c2e47800/6e4fcceb-7a26-44ed-a31b-b309e7102e93 for lustre-MDT0000 00000020:00000080:0.0:1788460637.788547:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc2fe7000 for lustre-MDT0000 00000100:00100000:3.0:1788460637.872591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460637.872685:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460637.872757:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460637.872879:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460637.873411:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732160 00000100:00100000:1.0:1788460637.873421:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732160 00000100:00100000:1.0:1788460637.873471:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732288 00000100:00100000:1.0:1788460637.873474:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732288 00000100:00100000:1.0:1788460637.873487:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732416 00000100:00100000:1.0:1788460637.873489:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732416 00000100:00100000:1.0:1788460637.873501:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732544 00000100:00100000:1.0:1788460637.873504:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732544 00000100:00100000:1.0:1788460637.873521:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460637.873530:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+13:2380:x1875336462732160:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460637.873544:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460637.873564:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea5200/0x889bb893541b8631 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16e6 expref: 13 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460637.873581:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460637.873648:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+12:2380:x1875336462732160:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 119us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460637.873656:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460637.873673:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460637.873680:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+11:2380:x1875336462732288:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460637.873688:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460637.873698:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea5e00/0x889bb893541b8669 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d171e expref: 11 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460637.873724:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460637.873760:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+10:2380:x1875336462732288:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 66us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460637.873767:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460637.873781:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460637.873788:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+9:2381:x1875336462732416:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460637.873795:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460637.873804:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029ce00/0x889bb893541b862a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16bc expref: 9 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460637.873813:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460637.873831:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d57050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+8:2381:x1875336462732416:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 44us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460637.873837:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460637.873873:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:1.0:1788460637.873880:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+7:2379:x1875336462732544:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460637.873887:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460637.873895:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009c00/0x889bb893541b8623 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d16b5 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460637.873904:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460637.873921:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:2379:x1875336462732544:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 42us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460637.873927:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460637.888000:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460637.888095:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732800 00000100:00100000:1.0:1788460637.888126:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732800 00000100:00100000:2.0:1788460637.889941:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1788460637.889965:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+6:2378:x1875336462732800:12345-192.168.203.32@tcp:39:umount.0 00000020:00000080:2.0:1788460637.890010:0:16645:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b863f 00000020:00010000:2.0:1788460637.890021:0:16645:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9650fde67800: total 0 00000100:00080000:2.0:1788460637.890025:0:16645:0:(import.c:65:import_set_state_nolock()) ffff9650fde60800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788460637.890056:0:16645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788460637.890687:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cc6eb25b-f5fb-4afa-a165-3499bc737f69+5:2378:x1875336462732800:12345-192.168.203.32@tcp:39:umount.0 Request processed in 730us (2694us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788460637.890696:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000020:00010000:3.0:1788460637.892429:0:14490:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9650fde67800: total 0 00010000:00010000:3.0:1788460637.892439:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460637.892516:0:14490:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9650fde67800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788460637.892553:0:14490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c52eda00) 00010000:00010000:3.0:1788460637.892557:0:14490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460637.892569:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c29f4a00/0x889bb893541b8718 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1748 expref: 4 pid: 14503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460637.892594:0:14490:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9650fde67800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788460637.892625:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460637.892627:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460637.892629:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460637.905597:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460637.905705:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462732928 00000100:00100000:2.0:1788460637.905715:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462732928 00000100:00100000:2.0:1788460637.905897:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 152 00000100:00100000:2.0:1788460637.905908:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+6:2378:x1875336462732928:12345-192.168.203.32@tcp:251:umount.0 00000020:00000080:2.0:1788460637.905969:0:14497:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b85dd 00000100:00080000:2.0:1788460637.905979:0:14497:0:(import.c:65:import_set_state_nolock()) ffff964fc1e84800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788460637.906061:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30b68111-22c2-4c96-9a8f-dff9e84f1a4c+1:2378:x1875336462732928:12345-192.168.203.32@tcp:251:umount.0 Request processed in 155us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460637.906069:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 152 00000020:00000080:2.0:1788460637.906079:0:14497:0:(genops.c:885:class_export_put()) final put ffff964fc1e86800/30b68111-22c2-4c96-9a8f-dff9e84f1a4c 00000020:00000080:2.0:1788460637.906123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc1e86800/30b68111-22c2-4c96-9a8f-dff9e84f1a4c for MGS 00000020:00000080:2.0:1788460637.906161:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc1e84800 for MGS 00010000:00010000:3.0:1788460637.906638:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460638.220641:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460638.732979:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482638976:0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733046:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460638.733125:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460638.733132:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482638592:0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733162:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460638.733239:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482639104:0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733262:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460638.733289:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638976 00000100:00100000:0.0:1788460638.733297:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638976 00000100:00100000:0.0:1788460638.733336:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639104 00000100:00100000:0.0:1788460638.733339:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639104 00000100:00100000:0.0:1788460638.733367:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460638.733375:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482638976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733430:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482638976:12345-0@lo:400:kworker.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460638.733437:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460638.733465:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460638.733472:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482639104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733514:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482639104:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460638.733520:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460638.733537:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638592 00000100:00100000:0.0:1788460638.733541:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638592 00000100:00100000:0.0:1788460638.733565:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788460638.733571:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482638592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733598:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482638592:12345-0@lo:400:kworker.0 Request processed in 28us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460638.733604:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788460638.733632:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460638.733657:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482638592:0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733670:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482639104:0@lo:400:kworker.0 00000100:00100000:0.0:1788460638.733678:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482638976:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.733999:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482638720:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734033:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460638.734065:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482639232:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734087:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460638.734124:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460638.734131:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482638848:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734150:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460638.734199:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639232 00000100:00100000:1.0:1788460638.734203:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639232 00000100:00100000:1.0:1788460638.734235:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788460638.734242:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482639232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734278:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482639232:12345-0@lo:400:kworker.0 Request processed in 37us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460638.734284:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788460638.734308:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638720 00000100:00100000:1.0:1788460638.734312:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638720 00000100:00100000:1.0:1788460638.734334:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482638848 00000100:00100000:1.0:1788460638.734337:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482638848 00000100:00100000:1.0:1788460638.734361:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460638.734367:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482638720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734619:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482638720:12345-0@lo:400:kworker.0 Request processed in 251us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460638.734626:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460638.734638:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788460638.734644:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482638848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734671:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482638848:12345-0@lo:400:kworker.0 Request processed in 28us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460638.734688:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788460638.734714:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460638.734717:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460638.734719:0:14498:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460638.734741:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482638848:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734752:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482638720:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.734761:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482639232:0@lo:400:kworker.0 00000100:00100000:1.0:1788460638.736304:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482639360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460638.736367:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460638.736732:0:15189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639360 00000100:00100000:0.0:1788460638.736741:0:15189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639360 00000100:00100000:0.0:1788460638.736793:0:15189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460638.736803:0:15189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482639360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460638.736840:0:15189:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788460638.736888:0:15189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482639360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460638.736896:0:15189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460638.736981:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482639360:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788460638.819014:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000020:00000080:2.0:1788460638.819023:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650c2e41000/6e4fcceb-7a26-44ed-a31b-b309e7102e93 00000020:00000080:3.0:1788460638.819168:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c2e41000/6e4fcceb-7a26-44ed-a31b-b309e7102e93 for lustre-OST0001 00000020:00000080:3.0:1788460638.819231:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c2e42000 for lustre-OST0001 00010000:00010000:1.0:1788460639.244796:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788460639.395125:0:17634:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:0.0:1788460639.415358:0:17634:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788460639.415411:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.415428:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.415436:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.415444:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.415471:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460639.415478:0:17634:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788460639.415499:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460639.415503:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788460639.415509:0:17634:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460639.415534:0:17634:0:(import.c:65:import_set_state_nolock()) ffff9650f6147000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788460639.417347:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460639.417359:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.417371:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460639.417375:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.417386:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460639.417395:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460639.417400:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460639.417403:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788460639.417406:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788460639.417460:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.417467:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460639.417496:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.417520:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a000/0x889bb893541b82aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b82b1 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.417534:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460639.417536:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460639.417538:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460639.417557:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482639616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460639.417624:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460639.419835:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639616 00000100:00100000:3.0:1788460639.419848:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639616 00000100:00100000:2.0:1788460639.420521:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482639488:0@lo:39:umount.0 00000100:00100000:2.0:1788460639.420584:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460639.420726:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460639.420741:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+23:3316:x1875336482639616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460639.420754:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460639.420774:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008a00/0x889bb893541b82b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b82aa expref: 23 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.420790:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460639.420828:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+22:3316:x1875336482639616:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460639.420835:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460639.420881:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482639616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460639.421266:0:14503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639488 00000100:00100000:0.0:1788460639.421273:0:14503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639488 00000100:00100000:0.0:1788460639.421310:0:14503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788460639.421318:0:14503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875336482639488:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788460639.421340:0:14503:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b82db 00000100:00080000:0.0:1788460639.421348:0:14503:0:(import.c:65:import_set_state_nolock()) ffff964fc2c5f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788460639.423731:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460639.424246:0:14503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3315:x1875336482639488:12345-0@lo:39:umount.0 Request processed in 2923us (3656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460639.424259:0:14503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:0.0:1788460639.424274:0:14503:0:(genops.c:885:class_export_put()) final put ffff9650f6145800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788460639.424305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6145800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788460639.424368:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc2c5f800 for lustre-MDT0000 00000100:00080000:2.0:1788460639.424736:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f6147000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788460639.424792:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482639488:0@lo:39:umount.0 00000100:00080000:0.0:1788460639.424843:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460639.424847:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788460639.424852:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788460639.434950:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.434969:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435003:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435009:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435030:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460639.435036:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435043:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435048:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435055:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435065:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788460639.435070:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435076:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435083:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435097:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435114:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788460639.435119:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435126:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435132:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435138:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435144:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788460639.435148:0:17634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435154:0:17634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435160:0:17634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435166:0:17634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460639.435199:0:17634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1788460639.435202:0:17634:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788460639.435295:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788460639.435303:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435310:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460639.435314:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435323:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460639.435331:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460639.435346:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460639.435349:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 10000000:01000000:2.0:1788460639.435351:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788460639.435407:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435413:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460639.435434:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435441:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec008200/0x889bb893541b8210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8217 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435454:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788460639.435457:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435462:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102167000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460639.435465:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435472:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460639.435478:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460639.435483:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460639.435485:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:2.0:1788460639.435491:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788460639.435508:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435514:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460639.435526:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435533:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102167000/0x889bb893541b850b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8512 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435541:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460639.435544:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435549:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460639.435552:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435558:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460639.435565:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460639.435570:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788460639.435571:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:2.0:1788460639.435573:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788460639.435588:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435593:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460639.435602:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435608:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029c000/0x889bb893541b8693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b869a expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435616:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460639.435619:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435624:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460639.435627:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435643:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460639.435650:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460639.435655:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460639.435657:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:2.0:1788460639.435658:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788460639.435677:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435682:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460639.435686:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435692:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8209 expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435708:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460639.435711:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435716:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460639.435719:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435726:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460639.435732:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460639.435737:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460639.435739:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788460639.435741:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788460639.435757:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435763:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460639.435767:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435773:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec008000/0x889bb893541b81f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b81fb expref: -99 pid: 14484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.435780:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460639.435781:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460639.435787:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460639.435804:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482639744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.435861:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460639.435899:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482640256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.435913:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460639.435932:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460639.435936:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482640128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.435952:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460639.435974:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639744 00000100:00100000:2.0:1788460639.435979:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639744 00000100:00100000:2.0:1788460639.436009:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640256 00000100:00100000:2.0:1788460639.436011:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640256 00000100:00100000:2.0:1788460639.436019:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640128 00000100:00100000:2.0:1788460639.436021:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640128 00000100:00100000:2.0:1788460639.436033:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460639.436040:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+24:3317:x1875336482639744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460639.436050:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460639.436062:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029c800/0x889bb893541b8217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8210 expref: 24 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.436073:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460639.436100:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+23:3317:x1875336482639744:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460639.436119:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460639.436133:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460639.436139:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+22:3317:x1875336482640256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460639.436145:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460639.436152:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d000/0x889bb893541b81fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b81f4 expref: 22 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.436166:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460639.436204:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+21:3317:x1875336482640256:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460639.436210:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460639.436235:0:14489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460639.436241:0:14489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+20:3317:x1875336482640128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460639.436248:0:14489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460639.436255:0:14489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029c400/0x889bb893541b8209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8202 expref: 20 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460639.436264:0:14489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460639.436282:0:14489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2de9e0bf-5e47-4625-abae-f266e65391be+19:3317:x1875336482640128:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460639.436287:0:14489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460639.436312:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482640128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.436319:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482639744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.436325:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482640256:0@lo:103:ldlm_bl.0 00000020:01000004:3.0:1788460639.436555:0:17634:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788460639.436559:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788460639.436563:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460639.436569:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788460639.436574:0:17634:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff964fc2fe7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460639.436580:0:17634:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9650c4ec2000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460639.436587:0:17634:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9650fde67800 cc6eb25b-f5fb-4afa-a165-3499bc737f69 192.168.203.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1788460639.436592:0:17634:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9650f5eb1988) has exports, disconnecting them 00000020:00080000:3.0:1788460639.436596:0:17634:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff964fc2fe7800), last request at 1788460638 00000020:00000080:3.0:1788460639.436603:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b84e1 00000100:00080000:3.0:1788460639.436618:0:17634:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788460639.436672:0:17634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff964fc2fe7800): rc 0 00000020:00000080:3.0:1788460639.436674:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2fe7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788460639.436684:0:17634:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9650c4ec2000), last request at 1788460638 00000020:00000080:3.0:1788460639.436687:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b837c 00000100:00080000:3.0:1788460639.436692:0:17634:0:(import.c:65:import_set_state_nolock()) ffff9650c3968800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788460639.436701:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2fe7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788460639.436736:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc2fe0800 for lustre-MDT0000 00000020:00080000:3.0:1788460639.436746:0:17634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650c4ec2000): rc 0 00000020:00000080:3.0:1788460639.436748:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c4ec2000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788460639.436756:0:17634:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa77dc1cb7ae0 00000020:00000080:3.0:1788460639.436764:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4ec2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788460639.436783:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c3968800 for lustre-MDT0000 00000100:00080000:3.0:1788460639.436798:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460639.436807:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788460639.436818:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788460639.436878:0:17634:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788460639.436890:0:17634:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788460639.436898:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460639.436900:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1788460639.436906:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788460639.437073:0:17634:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788460639.437083:0:17634:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788460639.437118:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9650f5eb1988) has no exports 00000100:00100000:3.0:1788460639.437161:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482639872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460639.437283:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460639.437312:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460639.437318:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482640000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460639.437341:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460639.437359:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460639.437528:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482639872 00000100:00100000:0.0:1788460639.437535:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482639872 00000100:00100000:0.0:1788460639.437568:0:14488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640000 00000100:00100000:0.0:1788460639.437571:0:14488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640000 00000100:00100000:0.0:1788460639.437587:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460639.437594:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+20:3318:x1875336482639872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460639.437604:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460639.437618:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102166200/0x889bb893541b8512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b850b expref: 20 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.437641:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460639.437680:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+19:3318:x1875336482639872:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460639.437686:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460639.437700:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460639.437706:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+18:3318:x1875336482640000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460639.437714:0:14488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460639.437722:0:14488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d400/0x889bb893541b869a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8693 expref: 18 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460639.437731:0:14488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460639.437747:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5d54050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2de9e0bf-5e47-4625-abae-f266e65391be+17:3318:x1875336482640000:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460639.437752:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788460639.438053:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5007800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482640000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460639.438068:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482639872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460639.438521:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482640384:0@lo:9:umount.0 00000100:00100000:2.0:1788460639.438561:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460639.438589:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482640512:0@lo:9:umount.0 00000100:00100000:2.0:1788460639.438609:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460639.438655:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460639.438775:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640384 00000100:00100000:0.0:1788460639.438781:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640384 00000100:00100000:0.0:1788460639.438820:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640512 00000100:00100000:0.0:1788460639.438824:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640512 00000100:00100000:0.0:1788460639.438844:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460639.438852:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875336482640384:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788460639.438874:0:15186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b83a6 00000100:00080000:0.0:1788460639.438883:0:15186:0:(import.c:65:import_set_state_nolock()) ffff9650f5c63800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460639.438914:0:15186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788460639.439421:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3315:x1875336482640384:12345-0@lo:9:umount.0 Request processed in 568us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460639.439430:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460639.439448:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460639.439455:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875336482640512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788460639.439469:0:15186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8519 00000100:00080000:0.0:1788460639.439476:0:15186:0:(import.c:65:import_set_state_nolock()) ffff9650c2e43800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460639.439497:0:15186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788460639.439768:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3315:x1875336482640512:12345-0@lo:9:umount.0 Request processed in 312us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460639.439775:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788460639.439797:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460639.439802:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460639.439827:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cff800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788460639.439840:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788460639.439842:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460639.439846:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482640384:0@lo:9:umount.0 00000100:00080000:0.0:1788460639.439858:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650f5cfa800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788460639.439868:0:3315:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788460639.439882:0:3315:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460639.439886:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482640512:0@lo:9:umount.0 00000020:00080000:0.0:1788460639.453566:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9650f5eb1988) has no exports 00000020:00000080:0.0:1788460639.505559:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b825d 00000020:00000080:0.0:1788460639.505575:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2382800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788460639.505592:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788460639.505830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2382800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788460639.505916:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460639.505926:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788460639.505931:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff964fc2274c98) has no exports 00000020:00000080:1.0:1788460639.506366:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8256 00000020:00000080:1.0:1788460639.506372:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650d025d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788460639.506424:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460639.506431:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788460639.506434:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc12d6800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788460639.506436:0:17634:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc12d6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788460639.506444:0:17634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788460639.506603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d025d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788460640.268432:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788460640.313647:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460640.313657:0:6730:0:(genops.c:885:class_export_put()) final put ffff9650f5c60800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788460640.313778:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5c60800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788460640.314058:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5c63800 for lustre-OST0000 00010000:00010000:0.0:1788460641.292405:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460642.316534:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788460642.872702:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000001:00080000:2.0:1788460642.872730:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1788460642.872735:0:5864:0:(genops.c:885:class_export_put()) final put ffff9650fde67800/cc6eb25b-f5fb-4afa-a165-3499bc737f69 00000020:00000080:1.0:1788460642.872865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fde67800/cc6eb25b-f5fb-4afa-a165-3499bc737f69 for lustre-MDT0000 00000020:00000080:1.0:1788460642.873242:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650fde60800 for lustre-MDT0000 00010000:00010000:0.0:1788460643.340333:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460643.852521:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460643.852543:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482640896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460643.852588:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482640768:0@lo:400:kworker.0 00000100:00100000:2.0:1788460643.852611:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460643.852664:0:16645:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640896 00000100:00100000:1.0:1788460643.852671:0:16645:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640896 00000100:00100000:1.0:1788460643.852717:0:16645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788460643.852726:0:16645:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1875336482640896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788460643.852735:0:16645:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788460643.852779:0:16645:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3317:x1875336482640896:12345-0@lo:400:kworker.0 Request processed in 52us (168us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788460643.852785:0:16645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788460643.852930:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460643.852959:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460643.852967:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482640640:0@lo:400:kworker.0 00000100:00100000:0.0:1788460643.853006:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788460643.853152:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788460643.853158:0:3317:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788460643.853161:0:3317:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788460643.858415:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640768 00000100:00100000:1.0:1788460643.858431:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640768 00000100:00100000:1.0:1788460643.858556:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788460643.858565:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875336482640768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788460643.858573:0:14501:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788460643.858643:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875336482640768:12345-0@lo:400:kworker.0 Request processed in 79us (5714us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788460643.858650:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788460643.858755:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788460643.858760:0:3319:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788460643.858764:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788460643.858770:0:3319:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460643.858774:0:3319:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 446 00000100:00080000:1.0:1788460643.858781:0:3319:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff964fc13c2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460643.858811:0:3319:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d108c380 x1875336482641024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460643.858835:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3319:1875336482640768:0@lo:400:kworker.0 00000100:00100000:1.0:1788460643.858900:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482641024:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788460643.858939:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460643.859081:0:14496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482640640 00000100:00100000:0.0:1788460643.859089:0:14496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482640640 00000100:00100000:1.0:1788460643.859137:0:14496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788460643.859146:0:14496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:3319:x1875336482640640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460643.859286:0:14496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2de9e0bf-5e47-4625-abae-f266e65391be+17:3319:x1875336482640640:12345-0@lo:400:kworker.0 Request processed in 141us (6279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460643.859293:0:14496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788460643.859328:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482640640:0@lo:400:kworker.0 00000100:00100000:1.0:1788460643.859440:0:14502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482641024 00000100:00100000:1.0:1788460643.859444:0:14502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482641024 00000100:00100000:1.0:1788460643.859540:0:14502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788460643.859545:0:14502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875336482641024:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788460643.859559:0:14502:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788460643.878012:0:3317:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460643.878022:0:3317:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 460 00000100:00080000:2.0:1788460643.878032:0:3317:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff964fc2fe5800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460643.878069:0:3317:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc45c00 x1875336482641152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460643.878105:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482640896:0@lo:400:kworker.0 00000100:00100000:0.0:1788460643.879115:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482641152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788460643.879213:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460643.879276:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482641152 00000100:00100000:0.0:1788460643.879283:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482641152 00000100:00100000:0.0:1788460643.879316:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460643.879323:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482641152:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788460643.879340:0:14501:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788460643.879380:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482641152:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (166us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788460643.879386:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788460643.879552:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460643.879557:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788460643.879561:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482641152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788460643.901507:0:14502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875336482641024:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41955us (42562us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788460643.901520:0:14502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788460643.902159:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460643.902166:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788460643.902170:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482641024:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:3.0:1788460643.905107:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460643.905117:0:7671:0:(genops.c:885:class_export_put()) final put ffff9650c2e41800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788460643.905233:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c2e41800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788460643.905281:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c2e43800 for lustre-OST0001 00010000:00010000:0.0:1788460644.364334:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460645.389003:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788460645.580314:0:17634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff964fc3682360 - data ffff9651001a4ca8/ffff964fc2cf9000 00000020:01000000:1.0:1788460645.580470:0:17634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650c3f93cc0 - data ffff9650d2301360/ffff9650f749cc00 00000001:00000004:1.0:1788460645.589109:0:17634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788460645.682008:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460645.682016:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788460645.682044:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460645.682046:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788460645.682707:0:14523:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788460645.682712:0:14523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788460645.682722:0:14523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788460645.684025:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460645.684031:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788460645.684049:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460645.684052:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788460645.685250:0:14525:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788460645.685256:0:14525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:1.0:1788460645.685266:0:14525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788460645.754838:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8225 00000020:00000080:0.0:1788460645.754851:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c8034800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788460645.756156:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b823a 00000020:00000080:0.0:1788460645.756165:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c8037800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788460645.756171:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788460645.756254:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.756263:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788460645.756267:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9650f5eb6620) has no exports 00000004:01000000:0.0:1788460645.756420:0:17634:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788460645.756427:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8287 00000020:00000080:0.0:1788460645.756511:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2387800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788460645.756516:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788460645.756521:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.756525:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788460645.756528:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff964fc2271988) has no exports 00000020:00000080:0.0:1788460645.756533:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8280 00000020:00000080:0.0:1788460645.756536:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650f5cfa000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788460645.757114:0:17634:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788460645.757120:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788460645.757124:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788460645.757130:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460645.757132:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788460645.757162:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.757168:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.757173:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8272 00000020:00000080:0.0:1788460645.757268:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2386000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788460645.757281:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788460645.757284:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.757288:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788460645.757291:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9650f5cf6620) has no exports 00000020:00000080:0.0:1788460645.757295:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b826b 00000020:00000080:0.0:1788460645.757298:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650f5cfe000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788460645.757819:0:17634:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788460645.757823:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788460645.757825:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788460645.757829:0:17634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788460645.757831:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788460645.757855:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.757860:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.758005:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.758047:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.758082:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8241 00000020:00000080:0.0:1788460645.758087:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c8035800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788460645.758091:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788460645.758095:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.758099:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788460645.758101:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9650f5eb4c98) has no exports 00000020:00000080:0.0:1788460645.758118:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.758122:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788460645.758127:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8248 00000020:00000080:0.0:1788460645.758130:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c8033800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788460645.758137:0:17634:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c5014000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788460645.758140:0:17634:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5014000 3 00000020:01000004:0.0:1788460645.758144:0:17634:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650c5014000 from lustre-MDT0000 00000020:00000080:0.0:1788460645.758159:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.758162:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788460645.758165:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c8030000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788460645.758167:0:17634:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8030000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788460645.758175:0:17634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788460645.758324:0:17634:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788460645.758327:0:17634:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788460645.758330:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788460645.758332:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.758335:0:17634:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460645.758341:0:17634:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9650c5013000 2de9e0bf-5e47-4625-abae-f266e65391be 0@lo 16 (0 0 11) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460645.758346:0:17634:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff964fc2273310) has exports, disconnecting them 00000020:00080000:0.0:1788460645.758350:0:17634:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9650c5013000), last request at 1788460558 00000020:00000080:0.0:1788460645.758362:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b81ed 00000020:00010000:0.0:1788460645.758366:0:17634:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9650c5013000: total 8 00000100:00080000:0.0:1788460645.758375:0:17634:0:(import.c:65:import_set_state_nolock()) ffff9650c5012000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788460645.758541:0:17634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650c5013000): rc 0 00000020:00080000:0.0:1788460645.758546:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff964fc2273310) has no exports 00000020:00000080:0.0:1788460645.758585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8034800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788460645.758594:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8037800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788460645.758598:0:37:0:(genops.c:885:class_export_put()) final put ffff9650d09a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788460645.758599:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d09a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788460645.758602:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.758695:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2387800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000100:00100000:1.0:1788460645.758747:0:14497:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9650e6c47c00:14497] 2 exiting: rc = 0 00000020:00000080:0.0:1788460645.758782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cfa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788460645.758787:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5cfa800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788460645.758791:0:37:0:(genops.c:885:class_export_put()) final put ffff964fc2381000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788460645.758793:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2381000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788460645.758795:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.758821:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2386000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788460645.758824:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cfe000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788460645.758827:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f5cff800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788460645.758830:0:37:0:(genops.c:885:class_export_put()) final put ffff9650f5cf8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788460645.758837:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5cf8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788460645.758839:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460645.758998:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8035800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788460645.759002:0:37:0:(genops.c:885:class_export_put()) final put ffff9650c8034000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788460645.759004:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8034000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788460645.759007:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788460645.759122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c8033800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788460645.759176:0:14495:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9650c3936c00:14495] 0 exiting: rc = 1 00000100:00100000:1.0:1788460645.759316:0:14496:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9650e6c46200:14496] 1 exiting: rc = 0 00000100:00100000:0.0:1788460645.759400:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759409:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759414:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759419:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759424:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759430:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759523:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759528:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759533:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759538:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759544:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759550:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759555:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759561:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759568:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759573:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759579:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759585:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759590:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759595:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759600:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759605:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759610:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759615:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759620:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759634:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759640:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759645:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759756:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759764:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759768:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759774:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759778:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759783:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759789:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759794:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759799:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759804:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759812:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759817:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759822:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759826:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759831:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759835:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759841:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759845:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759850:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759855:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759860:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759864:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759922:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759928:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759932:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759944:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759948:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759952:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759957:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759962:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759966:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759971:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759981:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759986:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759990:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.759995:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788460645.760422:0:17634:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788460645.760428:0:17634:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:3.0:1788460645.761097:0:14491:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9650c5013000: total 0 00010000:00010000:3.0:1788460645.761163:0:14491:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9650c5013000, canceled 0 locks, left on hash table 11. 00010000:00010000:3.0:1788460645.761216:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167200/0x889bb893541b84f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b84ef expref: 12 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761235:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff965102167800/0x889bb893541b8486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b847f expref: 11 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761245:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650fcd5bc00/0x889bb893541b8367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8360 expref: 10 pid: 14496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761256:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d800/0x889bb893541b8504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b84fd expref: 9 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761268:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029c600/0x889bb893541b8494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b848d expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761278:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009400/0x889bb893541b868c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8685 expref: 7 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761286:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029dc00/0x889bb893541b8313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b830c expref: 6 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761295:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029cc00/0x889bb893541b867e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8677 expref: 5 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761304:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029d600/0x889bb893541b8321 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b831a expref: 4 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761326:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb4600/0x889bb893541b84cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b84c5 expref: 3 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761335:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029da00/0x889bb893541b832f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b8328 expref: 2 pid: 14495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460645.761344:0:14491:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9650c5013000, canceled 11 locks, left on hash table 0. 00000020:00000080:3.0:1788460645.761360:0:14491:0:(genops.c:885:class_export_put()) final put ffff9650c5013000/2de9e0bf-5e47-4625-abae-f266e65391be 00010000:00010000:3.0:1788460645.761373:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460645.761375:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460645.761376:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788460645.761429:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c5013000/2de9e0bf-5e47-4625-abae-f266e65391be for MGS 00000020:00000080:0.0:1788460645.761468:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650c5012000 for MGS 00000020:01000000:0.0:1788460645.762157:0:17634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650c4fc6e40 - data ffff9650dd5951b0/ffff964fc3998c00 00000020:01000000:1.0:1788460645.762332:0:17634:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650d029f2a0 - data ffff9650dd74fa20/ffff9650fd25d000 00000020:00000080:1.0:1788460645.763025:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b81d1 00000020:00000080:1.0:1788460645.763033:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2c5b800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788460645.763049:0:17634:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c5014000 from MGS, refs=2 00000020:01000004:1.0:1788460645.763051:0:17634:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5014000 2 00000020:01000004:1.0:1788460645.763054:0:17634:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650c5014000 from MGS 00000020:00000080:3.0:1788460645.763131:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2c5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788460645.763325:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460645.763333:0:17634:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788460645.763336:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2c59800/MGS 00000020:00000080:1.0:1788460645.763338:0:17634:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2c59800/MGS for MGS 00000020:01000000:1.0:1788460645.763345:0:17634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788460645.763393:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788460645.763397:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460645.763402:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788460645.763408:0:17634:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9650f6145000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788460645.763413:0:17634:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9650f597cc98) has exports, disconnecting them 00000020:00080000:1.0:1788460645.763418:0:17634:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9650f6145000), last request at 1788460558 00000020:00000080:1.0:1788460645.763421:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b82bf 00000020:00080000:1.0:1788460645.763516:0:17634:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650f6145000): rc 0 00000020:00000080:1.0:1788460645.763522:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650f6145000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788460645.766065:0:17634:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788460645.766073:0:17634:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460645.766077:0:17634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788460645.766083:0:17634:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460645.766264:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6145000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788460645.766505:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460645.766513:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788460645.766518:0:17634:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c5014000 1 00000020:00000080:1.0:1788460645.766523:0:17634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b81c3 00000020:00000080:1.0:1788460645.766532:0:17634:0:(genops.c:885:class_export_put()) final put ffff964fc2c5c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460645.766629:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650f6147000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788460645.766635:0:36:0:(genops.c:885:class_export_put()) final put ffff9650f6143000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788460645.766637:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f6143000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788460645.766642:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1788460645.766808:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788460645.766814:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460645.766825:0:17634:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788460645.766829:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9650f597b310) has no exports 00000020:00000080:3.0:1788460645.767357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2c5c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788460645.804691:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.804706:0:17634:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788460645.804711:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650c5013800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788460645.804717:0:17634:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c5013800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788460645.804800:0:17634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788460645.806133:0:17634:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff9650c5017800 00000020:01000000:0.0:1788460645.806163:0:17634:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788460645.806169:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460645.806174:0:17634:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788460645.806204:0:17634:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9650f5eb3310) has no exports 00000100:00100000:0.0:1788460645.806292:0:14501:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9650fcaf3c00:14501] 0 exiting: rc = 1 00000100:00100000:0.0:1788460645.806420:0:14503:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9650e6c20200:14503] 2 exiting: rc = 0 00000100:00100000:3.0:1788460645.807173:0:16645:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff964fc270b600:16645] 3 exiting: rc = 0 00000100:00100000:0.0:1788460645.807398:0:14502:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9650fcaf3600:14502] 1 exiting: rc = 0 00000100:00100000:0.0:1788460645.807541:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807548:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807554:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807559:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807565:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807570:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807575:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807580:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807586:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807592:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807597:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807615:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807620:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807625:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807629:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807634:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807639:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807644:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807650:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807656:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807663:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807668:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807675:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807679:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807685:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807690:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807695:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807701:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807707:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807713:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807719:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807798:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807806:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807811:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807816:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807823:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807829:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807833:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807838:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807843:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807848:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807853:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.807861:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808045:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808055:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808068:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808079:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808084:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808089:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808094:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808099:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808104:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808111:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808116:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808123:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808129:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808135:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808141:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808146:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808153:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808161:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808168:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808175:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.808244:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.812673:0:14504:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9650e6c20000:14504] 0 exiting: rc = 1 00000100:00100000:0.0:1788460645.812932:0:14505:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9650e135c000:14505] 1 exiting: rc = 0 00000100:00100000:0.0:1788460645.813115:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813124:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813130:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813135:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813140:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813145:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813150:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813155:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813160:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813165:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813170:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813235:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813243:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813248:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813253:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813257:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813274:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813279:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813284:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813289:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813294:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813300:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813308:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813315:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813323:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813332:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813339:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813348:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813355:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813406:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813413:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813422:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813523:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813537:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813546:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813581:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813586:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813591:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813595:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813600:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813605:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813609:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813614:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813620:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813624:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813628:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813633:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813638:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813642:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813647:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813652:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813665:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813670:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813674:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813679:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813683:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813689:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813693:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813698:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813703:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813709:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813714:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813718:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.813785:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.815417:0:14506:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9650c38e7000:14506] 0 exiting: rc = 1 00000100:00100000:0.0:1788460645.816452:0:14507:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9650c38e7800:14507] 1 exiting: rc = 0 00000100:00100000:1.0:1788460645.829806:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.829899:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.829907:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.829912:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830096:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830105:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830115:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830120:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830126:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830132:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830149:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830156:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830162:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830170:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830176:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830203:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830210:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830217:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830224:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830232:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830313:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830328:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830443:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830459:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830467:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830474:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830480:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830486:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830493:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830500:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830506:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830513:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830519:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830540:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830569:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830577:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830584:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830590:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830596:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830602:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830608:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830614:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830621:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830627:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830632:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830640:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830673:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830682:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830690:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830696:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830702:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830707:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830713:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830719:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830725:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830731:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830736:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830742:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830760:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830767:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830772:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830777:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830783:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.830794:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.843888:0:14509:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9650efb6d000:14509] 1 exiting: rc = 0 00000100:00100000:1.0:1788460645.844590:0:14508:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9650c38e6a00:14508] 0 exiting: rc = 1 00000100:00100000:0.0:1788460645.844851:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844859:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844865:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844883:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844889:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844895:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844899:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844905:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844910:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844915:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844921:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844927:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844931:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844945:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844949:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844954:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844959:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844964:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844969:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844973:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844978:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844995:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.844999:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845004:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845009:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845014:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845020:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845025:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845029:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845034:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845038:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845042:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845047:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845052:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845066:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845072:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845076:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845081:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845086:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845090:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845095:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845101:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845358:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845363:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845368:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845374:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845379:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845384:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845389:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845394:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845399:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845404:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845409:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845415:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845420:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845424:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845451:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845457:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845462:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845468:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845474:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845479:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845484:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.845490:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.849348:0:14511:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9650efb6d800:14511] 1 exiting: rc = 0 00000100:00100000:1.0:1788460645.852799:0:14510:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9650efb6de00:14510] 0 exiting: rc = 1 00000100:00100000:0.0:1788460645.852945:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852954:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852961:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852966:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852972:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852977:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852982:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852987:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852993:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.852997:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853002:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853007:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853011:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853016:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853020:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853024:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853029:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853033:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853038:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853043:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853047:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853051:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853066:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853072:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853077:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853082:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853087:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853115:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853120:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853125:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853131:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853135:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853140:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853145:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853150:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853154:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853159:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853164:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853169:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853174:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853216:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853221:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853226:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853232:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853236:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853241:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853246:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853251:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853257:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853261:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853266:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853272:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853276:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853281:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853286:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853291:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853296:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853301:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853307:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853311:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853316:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853322:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853335:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460645.853340:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.857488:0:14513:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9650efb6c200:14513] 1 exiting: rc = 0 00000100:00100000:0.0:1788460645.862594:0:14512:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9650efb6c800:14512] 0 exiting: rc = 1 00000100:00100000:1.0:1788460645.862714:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862722:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862747:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862753:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862759:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862765:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862771:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862778:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862785:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862792:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862799:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862806:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862814:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862821:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862828:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862835:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862843:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862851:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862859:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862866:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862873:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862880:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862886:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862894:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862900:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862908:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862915:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862921:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862941:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862952:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862961:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862970:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862977:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862982:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862986:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.862992:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863004:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863018:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863023:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863029:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863034:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863039:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863044:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863049:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863054:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863067:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863073:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863078:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863083:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863088:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863093:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863098:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863103:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863108:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863113:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863118:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863122:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863127:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863131:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863136:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863141:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863146:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863150:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.863155:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460645.863794:0:14515:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9650efb6d200:14515] 1 exiting: rc = 0 00000100:00100000:3.0:1788460645.863953:0:14516:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9650efb6c000:14516] 2 exiting: rc = 0 00000100:00100000:0.0:1788460645.864166:0:14514:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9650efd36600:14514] 0 exiting: rc = 1 00000100:00100000:1.0:1788460645.864834:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864842:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864847:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864853:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864858:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864863:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864868:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864874:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864893:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864899:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864905:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864911:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864917:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864923:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864938:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864945:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864953:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864959:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864965:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864970:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864975:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864981:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864987:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.864993:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865022:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865029:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865034:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865040:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865046:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865051:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865217:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865226:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865232:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865237:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865242:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865248:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865253:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865259:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865264:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865271:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865277:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865282:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865288:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865301:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865307:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865312:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865318:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865323:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865344:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865351:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865357:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865362:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865368:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865692:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865700:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865705:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865710:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865715:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865720:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865725:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865733:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865747:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865754:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460645.865761:0:17634:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788460645.880975:0:17634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460645.880989:0:17634:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788460645.880995:0:17634:0:(genops.c:885:class_export_put()) final put ffff9650d0bf7000/MDS_uuid 00000020:00000080:0.0:1788460645.881000:0:17634:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d0bf7000/MDS_uuid for MDS 00000020:01000000:0.0:1788460645.881010:0:17634:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788460645.881222:0:17634:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788460646.417937:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460647.436669:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460648.462927:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460648.973268:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460648.973275:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788460648.973278:0:36:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460648.973286:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1788460648.973292:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788460648.973298:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff964fc13c2800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460648.973319:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650fd3c5500 x1875336482641408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460648.973335:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460648.973339:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788460648.973340:0:36:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460648.973343:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 517 00000100:00080000:0.0:1788460648.973346:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788460648.973349:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff964fc2fe5800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460648.973359:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650fd3c5180 x1875336482641536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460648.973378:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460648.973398:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482641280:0@lo:400:kworker.0 00000400:00000100:0.0:1788460648.973443:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336482641280 offset 0 length 224: 4 00000100:00100000:0.0:1788460648.973506:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482641408:0@lo:38:kworker.0 00000400:00000100:0.0:1788460648.973525:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336482641408 offset 0 length 520: 4 00000100:00100000:0.0:1788460648.973538:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482641536:0@lo:38:kworker.0 00000400:00000100:0.0:1788460648.973552:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336482641536 offset 0 length 520: 4 00000020:01000004:0.0:1788460649.046666:0:17789:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:0.0:1788460649.064313:0:17789:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788460649.064363:0:17789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.064378:0:17789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.064386:0:17789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.064394:0:17789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.064420:0:17789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460649.064438:0:17789:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-client 10000000:01000000:0.0:1788460649.064443:0:17789:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788460649.064476:0:17789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460649.064488:0:17789:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650fd3c5500 x1875336482641408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460663 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460649.064512:0:17789:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788460649.064518:0:17789:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460649.064537:0:17789:0:(import.c:65:import_set_state_nolock()) ffff964fc13c2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788460649.064543:0:17789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460649.064548:0:17789:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650fd3c5500 x1875336482641408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460663 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460649.064554:0:17789:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788460649.064557:0:17789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:2.0:1788460649.064698:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482641408:0@lo:38:kworker.0 00010000:00010000:3.0:1788460649.065174:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460649.065248:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.065258:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460649.065262:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.065271:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460649.065279:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460649.065285:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460649.065288:0:14491:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788460649.065290:0:14491:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788460649.065341:0:14491:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.065347:0:14491:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788460649.065417:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1788460649.065437:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.065445:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a800/0x889bb893541b8360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8367 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.065457:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460649.065459:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460649.065460:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460649.065779:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482641664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460649.065839:0:17789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065848:0:17789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065855:0:17789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065862:0:17789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065886:0:17789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460649.065901:0:17789:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-OST0000 00000100:00100000:2.0:1788460649.065905:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460649.065906:0:17789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065977:0:17789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065983:0:17789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.065989:0:17789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066012:0:17789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788460649.066019:0:17789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066025:0:17789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066031:0:17789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066046:0:17789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066053:0:17789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788460649.066061:0:17789:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear params 00010000:00010000:0.0:1788460649.066066:0:17789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066073:0:17789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066080:0:17789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066085:0:17789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460649.066093:0:17789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788460649.066156:0:17789:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788460649.066160:0:17789:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788460649.066204:0:17789:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788460649.066208:0:17789:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788460649.066213:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460649.066219:0:17789:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788460649.066223:0:17789:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff964fc2276620) has no exports 00000020:00080000:0.0:1788460649.066244:0:17789:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff964fc2276620) has no exports 00010000:00010000:3.0:1788460649.066312:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788460649.066323:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066330:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5a400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460649.066334:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066342:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460649.066349:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460649.066355:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460649.066358:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 10000000:01000000:3.0:1788460649.066359:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788460649.066398:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066405:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460649.066419:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066425:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a400/0x889bb893541b8328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b832f expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066435:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460649.066438:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066444:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029d200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460649.066452:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066459:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460649.066465:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460649.066471:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460649.066473:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788460649.066475:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788460649.066495:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066501:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460649.066516:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066523:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029d200/0x889bb893541b84fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8504 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066533:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460649.066536:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066542:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460649.066545:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066551:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460649.066568:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460649.066574:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788460649.066575:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788460649.066577:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788460649.066608:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066613:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460649.066620:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066626:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec008c00/0x889bb893541b8685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b868c expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066634:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460649.066637:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066643:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650fcd5ba00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460649.066645:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066652:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460649.066658:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460649.066673:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460649.066675:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788460649.066677:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788460649.066697:0:14490:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066702:0:14490:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460649.066708:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066720:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650fcd5ba00/0x889bb893541b830c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b8313 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460649.066731:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460649.066732:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460649.066734:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460649.066751:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482641920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460649.066793:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482642048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460649.066814:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482642176:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460649.066993:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460649.067200:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460649.067276:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482641792:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1788460649.069679:0:17789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650e6ef7420 - data ffff9650dd49cbd0/ffff9650ed403c00 00000020:01000000:0.0:1788460649.069837:0:17789:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650d28a7060 - data ffff9650d2388e58/ffff964fc1969000 00000100:00100000:3.0:1788460649.070108:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460649.070293:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482641664 00000100:00100000:1.0:1788460649.070303:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482641664 00000100:00100000:1.0:1788460649.070377:0:14487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642176 00000100:00100000:1.0:1788460649.070381:0:14487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642176 00000100:00100000:0.0:1788460649.070413:0:14488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460649.070421:0:14488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3319:x1875336482641664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788460649.070429:0:14488:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460649 with bad export cookie 9843664353459143149 00000100:00100000:3.0:1788460649.070707:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460649.070745:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460649.070940:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482641792 00000100:00100000:2.0:1788460649.070958:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482641792 00000100:00100000:2.0:1788460649.070977:0:14489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788460649.070985:0:14489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788460649.071434:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642048 00000100:00100000:3.0:1788460649.071439:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642048 00000100:00100000:3.0:1788460649.071458:0:14489:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788460649.071464:0:14489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482641920 00000100:00100000:3.0:1788460649.071474:0:14489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482641920 00000100:00100000:2.0:1788460649.071594:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788460649.071602:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875336482642176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460649.071609:0:17790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460649 with bad export cookie 9843664353459143149 00000100:00100000:2.0:1788460649.073486:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3318:x1875336482642176:12345-0@lo:103:ldlm_bl.0 Request processed in 1874us (6277us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460649.073500:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788460649.073615:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460649.073621:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3319:x1875336482641792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460649.073627:0:17790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460649 with bad export cookie 9843664353459143149 00000100:00100000:2.0:1788460649.073696:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3319:x1875336482641792:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (3599us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460649.073702:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460649.073717:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460649.073722:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1875336482642048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460649.073736:0:17790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460649 with bad export cookie 9843664353459143149 00000100:00100000:2.0:1788460649.073779:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3317:x1875336482642048:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (3072us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460649.073785:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460649.073798:0:17790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460649.073802:0:17790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1875336482641920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460649.073806:0:17790:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460649 with bad export cookie 9843664353459143149 00000100:00100000:2.0:1788460649.073836:0:17790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3316:x1875336482641920:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (3090us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460649.073841:0:17790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788460649.074088:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788460649.074164:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf0800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788460649.074169:0:3318:0:(import.c:186:ptlrpc_set_import_discon()) mgc192.168.203.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788460649.074249:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788460649.074348:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.203.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788460649.092671:0:14488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3319:x1875336482641664:12345-0@lo:103:ldlm_bl.0 Request processed in 22245us (26761us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788460649.092684:0:14488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788460649.127724:0:3318:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for mgc192.168.203.132@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788460649.127730:0:3318:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788460649.127742:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650fd3c6a00 x1875336482641280/t0(0) o400->mgc192.168.203.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788460664 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460649.127758:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcff800 x1875336482641664/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460665 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460649.127768:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcff100 x1875336482641920/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460665 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460649.127776:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcfc000 x1875336482642048/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460665 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460649.127785:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcfea00 x1875336482642176/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460665 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460649.127792:0:3318:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcffb80 x1875336482641792/t0(0) o103->mgc192.168.203.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460665 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460649.128050:0:3319:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9650d0bf0800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788460649.128093:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482641664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460649.128136:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2de9e0bf-5e47-4625-abae-f266e65391be:3319:1875336482641792:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788460649.128234:0:3318:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788460649.128238:0:3318:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 00000100:00100000:1.0:1788460649.128238:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482641920:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788460649.128240:0:3318:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788460649.128243:0:3318:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf0800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460649.128339:0:3317:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9650d0bf0800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1788460649.128433:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2de9e0bf-5e47-4625-abae-f266e65391be:3317:1875336482642048:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788460649.131941:0:3318:0:(import.c:545:import_select_connection()) mgc192.168.203.132@tcp: connect to NID 0@lo last attempt 431 00000100:00080000:3.0:1788460649.131955:0:3318:0:(import.c:665:import_select_connection()) mgc192.168.203.132@tcp: import ffff9650d0bf0800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460649.132003:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2de9e0bf-5e47-4625-abae-f266e65391be:3316:1875336482641280:0@lo:400:kworker.0 00000100:00100000:3.0:1788460649.132421:0:3318:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efcff100 x1875336482642304/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460649.132549:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2de9e0bf-5e47-4625-abae-f266e65391be:3315:1875336482642304:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788460649.132596:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336482642304 offset 0 length 520: 4 00000100:00100000:3.0:1788460649.132663:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2de9e0bf-5e47-4625-abae-f266e65391be:3318:1875336482642176:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1788460649.134395:0:17789:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788460649.153613:0:17789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b833d 00000020:00000080:2.0:1788460649.153623:0:17789:0:(genops.c:885:class_export_put()) final put ffff9650f5c67800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788460649.153643:0:17789:0:(tgt_mount.c:201:server_put_mount()) put mount ffff964fc19a9000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788460649.153647:0:17789:0:(obd_mount.c:798:lustre_put_lsi()) put ffff964fc19a9000 2 00000020:01000004:2.0:1788460649.153650:0:17789:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff964fc19a9000 from lustre-OST0000 00000020:00000080:2.0:1788460649.153670:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460649.153679:0:17789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788460649.153682:0:17789:0:(genops.c:885:class_export_put()) final put ffff9650f5c60000/lustre-OST0000_UUID 00000020:00000080:2.0:1788460649.153684:0:17789:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5c60000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788460649.153690:0:17789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788460649.153746:0:17789:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788460649.153751:0:17789:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788460649.153755:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460649.153760:0:17789:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788460649.153766:0:17789:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9650c4ec4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788460649.153772:0:17789:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9650f5cf3310) has exports, disconnecting them 00000020:00080000:2.0:1788460649.153776:0:17789:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9650c4ec4000), last request at 1788460573 00000020:00000080:2.0:1788460649.153780:0:17789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8375 00000020:00080000:2.0:1788460649.153789:0:17789:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650c4ec4000): rc 0 00000020:00000080:2.0:1788460649.153794:0:17789:0:(genops.c:885:class_export_put()) final put ffff9650c4ec4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788460649.154517:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5c67800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788460649.154526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4ec4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788460649.155383:0:17789:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788460649.155388:0:17789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460649.155393:0:17789:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788460649.155400:0:17789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460649.155595:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460649.155602:0:17789:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788460649.155608:0:17789:0:(obd_mount.c:798:lustre_put_lsi()) put ffff964fc19a9000 1 00000020:00000080:3.0:1788460649.155613:0:17789:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b82fe 00000020:00000080:3.0:1788460649.155619:0:17789:0:(genops.c:885:class_export_put()) final put ffff964fc19ab800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788460649.155724:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc13c2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788460649.155730:0:36:0:(genops.c:885:class_export_put()) final put ffff9650c4ec3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788460649.155733:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4ec3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788460649.155738:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788460649.155948:0:17789:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788460649.155954:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460649.155959:0:17789:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460649.155962:0:17789:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9650f5979988) has no exports 00000020:00000080:1.0:1788460649.157648:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc19ab800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788460649.167391:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460649.167408:0:17789:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788460649.167413:0:17789:0:(genops.c:885:class_export_put()) final put ffff964fc19ac000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788460649.167418:0:17789:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc19ac000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788460649.167424:0:17789:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788460649.169262:0:17789:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff964fc19aa800 00000020:02000400:3.0:1788460649.169318:0:17789:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788460649.484464:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460650.508928:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.536075:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788460651.898400:0:17939:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:1.0:1788460651.905416:0:17939:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788460651.906303:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.906319:0:17939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.906326:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.906333:0:17939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.906358:0:17939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460651.906376:0:17939:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-client 10000000:01000000:1.0:1788460651.906380:0:17939:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788460651.906402:0:17939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460651.906412:0:17939:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650fd3c5180 x1875336482641536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460663 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460651.906425:0:17939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788460651.906456:0:17939:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788460651.906461:0:17939:0:(import.c:65:import_set_state_nolock()) ffff964fc2fe5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788460651.906467:0:17939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460651.906472:0:17939:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650fd3c5180 x1875336482641536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460663 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460651.906480:0:17939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788460651.906483:0:17939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1788460651.906718:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482641536:0@lo:38:kworker.0 00010000:00010000:3.0:1788460651.906791:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460651.906799:0:14491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.906806:0:14491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff965102166000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460651.906809:0:14491:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.906818:0:14491:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460651.906833:0:14491:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460651.906838:0:14491:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460651.906842:0:14491:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:3.0:1788460651.906844:0:14491:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788460651.906870:0:14491:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:3.0:1788460651.906874:0:14491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.906880:0:14491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff965102166000/0x889bb893541b84c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b84cc expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.906891:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.906892:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.906894:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460651.910961:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.910978:0:17939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.910986:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.910992:0:17939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911023:0:17939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460651.911040:0:17939:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-OST0001 00010000:00010000:1.0:1788460651.911046:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911053:0:17939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911059:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911070:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460651.911077:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911078:0:17939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911085:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5400 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460651.911088:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911097:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911099:0:17939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:3.0:1788460651.911105:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911106:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911113:0:17939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911120:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460651.911121:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460651.911124:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:1.0:1788460651.911126:0:17939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911132:0:17939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788460651.911134:0:14490:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:3.0:1788460651.911137:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460651.911138:0:17939:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear params 00010000:00010000:1.0:1788460651.911142:0:17939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911144:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5400/0x889bb893541b848d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b8494 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911149:0:17939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911154:0:17939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911157:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460651.911160:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460651.911161:0:17939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911165:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ca00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460651.911168:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911174:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460651.911201:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460651.911207:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460651.911209:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788460651.911211:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788460651.911232:0:14490:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:3.0:1788460651.911235:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911251:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029ca00/0x889bb893541b84ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b84f6 expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911265:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460651.911268:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911273:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460651.911276:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911282:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460651.911287:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460651.911292:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788460651.911294:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788460651.911296:0:14490:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788460651.911313:0:14490:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:3.0:1788460651.911315:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911322:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650d029c200/0x889bb893541b8677 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b867e expref: -99 pid: 14499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.911331:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.911333:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.911340:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460651.911390:0:14491:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460651.911968:0:17939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460651.912919:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460651.912926:0:14490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.912936:0:14490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460651.912939:0:14490:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.912948:0:14490:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460651.912955:0:14490:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460651.912961:0:14490:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460651.912963:0:14490:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 00010000:00010000:3.0:1788460651.912971:0:14490:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:3.0:1788460651.912975:0:14490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.912981:0:14490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b847f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b8486 expref: -99 pid: 15899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460651.912996:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.912998:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460651.913000:0:14490:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788460651.914367:0:17939:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.203.132@tcp: clear lustre-sptlrpc 10000000:01000000:1.0:1788460651.914374:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 10000000:01000000:1.0:1788460651.914400:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788460651.914415:0:17939:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788460651.914437:0:17939:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788460651.914828:0:17939:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788460651.914834:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460651.914841:0:17939:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788460651.914846:0:17939:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff964fc2270000) has no exports 00000020:00080000:1.0:1788460651.914870:0:17939:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff964fc2270000) has no exports 00000020:01000000:1.0:1788460651.921853:0:17939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650e6ef7720 - data ffff9650dd44baf8/ffff964fc111c800 00000020:01000000:1.0:1788460651.922038:0:17939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9650c7c56900 - data ffff9650fce96bd0/ffff964fc3e4dc00 00100000:10000000:1.0:1788460651.932460:0:17939:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788460651.967771:0:17939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b84a2 00000020:00000080:2.0:1788460651.967781:0:17939:0:(genops.c:885:class_export_put()) final put ffff964fc2fe4800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788460651.967804:0:17939:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650c4ec5800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788460651.967808:0:17939:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c4ec5800 2 00000020:01000004:2.0:1788460651.967811:0:17939:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff9650c4ec5800 from lustre-OST0001 00000020:00000080:2.0:1788460651.967847:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460651.967856:0:17939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788460651.967860:0:17939:0:(genops.c:885:class_export_put()) final put ffff964fc2fe6000/lustre-OST0001_UUID 00000020:00000080:2.0:1788460651.967862:0:17939:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2fe6000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788460651.967869:0:17939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1788460651.967979:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc2fe4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1788460651.968315:0:17939:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import 2de9e0bf-5e47-4625-abae-f266e65391be->MGS 00010000:00010000:2.0:1788460651.968399:0:17939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460651.968412:0:17939:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460651.968419:0:17939:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788460651.968422:0:17939:0:(mgc_request.c:1259:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788460651.968425:0:17939:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788460651.968457:0:17939:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9650d0bf0800 00010000:00010000:2.0:1788460651.968461:0:17939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650fcd5a600/0x889bb893541b831a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x889bb893541b8321 expref: -99 pid: 15183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788460651.968481:0:17939:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf0800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788460651.968485:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788460651.968487:0:17939:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788460651.968489:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788460651.968493:0:17939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788460651.968504:0:17939:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9650efcff100 x1875336482642304/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788460659 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788460651.968559:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788460651.968562:0:17939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1788460651.968611:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2de9e0bf-5e47-4625-abae-f266e65391be:3315:1875336482642304:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:2.0:1788460651.968666:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788460651.968673:0:17939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b81df 00000020:00000080:2.0:1788460651.968678:0:17939:0:(genops.c:885:class_export_put()) final put ffff9650d0bf3000/2de9e0bf-5e47-4625-abae-f266e65391be 00000020:01000000:2.0:1788460651.968716:0:17939:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of mgc192.168.203.132@tcp (flags='') 00000020:00000080:2.0:1788460651.968727:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460651.968733:0:17939:0:(obd_config.c:956:class_cleanup()) mgc192.168.203.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788460651.968738:0:17939:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9650f5eb0000) has no exports 10000000:01000000:0.0:1788460651.968803:0:14499:0:(mgc_request.c:989:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788460651.968880:0:17939:0:(obd_class.h:688:obd_cleanup_client_import()) mgc192.168.203.132@tcp: client import never connected 00000100:00080000:2.0:1788460651.968884:0:17939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788460651.968886:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788460651.968888:0:17939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788460651.968889:0:17939:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788460651.968981:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d0bf3000/2de9e0bf-5e47-4625-abae-f266e65391be for mgc192.168.203.132@tcp 00000020:00000080:2.0:1788460651.969214:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460651.969220:0:17939:0:(obd_config.c:883:class_detach()) detach on obd mgc192.168.203.132@tcp (uuid 2de9e0bf-5e47-4625-abae-f266e65391be) 00000020:01000000:2.0:1788460651.969225:0:17939:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788460651.969229:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460651.969233:0:17939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788460651.969237:0:17939:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9650fc7a5800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788460651.969243:0:17939:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff964fc128cc98) has exports, disconnecting them 00000020:00080000:2.0:1788460651.969248:0:17939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9650fc7a5800), last request at 1788460587 00000020:00000080:2.0:1788460651.969251:0:17939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b84da 00000020:00080000:2.0:1788460651.969262:0:17939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9650fc7a5800): rc 0 00000020:00000080:2.0:1788460651.969266:0:17939:0:(genops.c:885:class_export_put()) final put ffff9650fc7a5800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788460651.969303:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9650d0bf0800 for mgc192.168.203.132@tcp 00000020:00000080:3.0:1788460651.969316:0:36:0:(genops.c:885:class_export_put()) final put ffff9650d0bf1000/2de9e0bf-5e47-4625-abae-f266e65391be 00000020:00000080:3.0:1788460651.969318:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650d0bf1000/2de9e0bf-5e47-4625-abae-f266e65391be for mgc192.168.203.132@tcp 00000020:01000000:3.0:1788460651.969323:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd mgc192.168.203.132@tcp (2de9e0bf-5e47-4625-abae-f266e65391be) 00000020:00000080:3.0:1788460651.970716:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650fc7a5800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788460651.974430:0:17939:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788460651.974438:0:17939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460651.974442:0:17939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788460651.974449:0:17939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788460651.974513:0:14491:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788460651.974621:0:14490:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:0.0:1788460651.974716:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff964fc2fe5800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1788460651.979284:0:14486:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9650d83e1400:14486] 1 exiting: rc = 0 00000100:00100000:0.0:1788460651.980289:0:14485:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9650c3253000:14485] 0 exiting: rc = 1 00000100:00100000:3.0:1788460651.980396:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460651.980702:0:17790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9650e8931800:17790] 3 exiting: rc = 0 00000100:00100000:0.0:1788460651.980770:0:14488:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9650d83e0a00:14488] 1 exiting: rc = 0 00000100:00100000:3.0:1788460651.985294:0:14489:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9650d0828800:14489] 2 exiting: rc = 0 00000100:00100000:0.0:1788460651.986365:0:14487:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9650c6457a00:14487] 0 exiting: rc = 1 00000100:00100000:3.0:1788460651.986504:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986513:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986520:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986527:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986534:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986542:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986548:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986554:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986558:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986564:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986582:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986588:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986594:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986599:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986604:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986609:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986614:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986620:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986626:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986641:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986646:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986652:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986658:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986664:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986670:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986676:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986681:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986687:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986693:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986698:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986704:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986709:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986715:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986720:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986725:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986731:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986737:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986742:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986746:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986752:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986757:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986763:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986768:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986773:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986779:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986786:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986792:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986797:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986804:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986808:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986813:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986819:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986824:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986829:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986844:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986851:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986859:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986864:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986870:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986882:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986902:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986909:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986919:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460651.986925:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788460651.987799:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460651.987809:0:17939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788460651.987814:0:17939:0:(genops.c:885:class_export_put()) final put ffff964fc1a0c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788460651.987818:0:17939:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc1a0c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788460651.987823:0:17939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788460651.987862:0:17939:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650c4ec5800 1 00000020:00000080:3.0:1788460651.987867:0:17939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x889bb893541b8478 00000020:00000080:3.0:1788460651.987873:0:17939:0:(genops.c:885:class_export_put()) final put ffff9650f5c65800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788460651.987890:0:17939:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788460651.987895:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460651.987899:0:17939:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460651.987903:0:17939:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9650f5cf4c98) has no exports 00000020:00000080:0.0:1788460651.988498:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9650f5c65800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788460652.021753:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460652.021767:0:17939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788460652.021777:0:17939:0:(genops.c:885:class_export_put()) final put ffff9650c4ec5000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788460652.021782:0:17939:0:(genops.c:844:class_export_destroy()) destroying export ffff9650c4ec5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788460652.021789:0:17939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788460652.022012:0:17939:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff9650c4ec1000 00000020:01000000:0.0:1788460652.022042:0:17939:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788460652.022046:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460652.022050:0:17939:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788460652.022054:0:17939:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9650f5978000) has no exports 00000020:00000080:0.0:1788460652.022097:0:17939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460652.022102:0:17939:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788460652.022106:0:17939:0:(genops.c:885:class_export_put()) final put ffff964fc19a9800/OSS_uuid 00000020:00000080:0.0:1788460652.022108:0:17939:0:(genops.c:844:class_export_destroy()) destroying export ffff964fc19a9800/OSS_uuid for OSS 00000020:01000000:0.0:1788460652.022112:0:17939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788460652.022214:0:15184:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9650c259ce00:15184] 0 exiting: rc = 1 00000100:00080000:3.0:1788460652.022325:0:14498:0:(pinger.c:555:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788460652.022432:0:15187:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff964fc12bec00:15187] 2 exiting: rc = 0 00000100:00100000:3.0:1788460652.024306:0:16370:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9650fe0d9600:16370] 3 exiting: rc = 0 00000100:00100000:1.0:1788460652.026954:0:15186:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9650cab9ec00:15186] 1 exiting: rc = 0 00000100:00100000:3.0:1788460652.027271:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027292:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027298:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027304:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027310:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027316:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027324:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027332:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027353:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027364:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027372:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027382:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027392:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027403:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027411:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027420:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027432:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027443:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027452:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027458:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027462:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027467:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027472:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027477:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027483:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027488:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027493:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027498:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027504:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027511:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027519:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027526:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027532:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027542:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027551:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027579:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027593:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027605:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027615:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027626:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027635:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027644:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027651:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027669:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027689:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027698:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027708:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027718:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027728:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027740:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027752:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027763:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027773:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027800:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027810:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027820:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027830:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027839:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027849:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027859:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027868:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027879:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027888:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.027894:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.032631:0:15188:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9650d0804e00:15188] 0 exiting: rc = 1 00000100:00100000:0.0:1788460652.032791:0:15189:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9650efd33600:15189] 1 exiting: rc = 0 00000100:00100000:3.0:1788460652.032863:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032875:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032881:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032888:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032894:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032899:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032905:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032910:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032916:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032922:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032927:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032933:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032939:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032943:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032963:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032968:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032973:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032979:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.032995:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033001:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033007:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033013:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033027:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033032:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033038:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033042:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033048:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033053:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033058:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033063:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033069:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033074:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033081:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033087:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033092:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033097:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033103:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033108:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033113:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033119:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033124:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033129:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033135:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033139:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033145:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033150:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033157:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033163:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033168:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033203:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033209:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033214:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033218:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033237:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033242:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033248:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033252:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033257:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033262:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033267:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033271:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033276:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033282:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.033287:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.034167:0:15190:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff964fc12bf000:15190] 0 exiting: rc = 1 00000100:00100000:3.0:1788460652.034334:0:16726:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9650d148de00:16726] 4 exiting: rc = 0 00000100:00100000:0.0:1788460652.034813:0:16727:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_005: service thread [ffff9650ea554600:16727] 5 exiting: rc = 0 00000100:00100000:0.0:1788460652.034984:0:15192:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9650f591b000:15192] 2 exiting: rc = 0 00000100:00100000:1.0:1788460652.035665:0:15191:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9650f591be00:15191] 1 exiting: rc = 0 00000100:00100000:1.0:1788460652.035909:0:16723:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff964fc1eb5400:16723] 3 exiting: rc = 0 00000100:00100000:0.0:1788460652.036375:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036383:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036388:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036393:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036398:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036412:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036419:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036425:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036431:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036436:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036441:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036459:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036464:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036470:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036476:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036481:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036487:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036492:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036498:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036503:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036508:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036513:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036531:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036537:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036542:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036547:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036552:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036575:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036581:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036587:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036593:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036597:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036604:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036608:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036613:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036618:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036624:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036630:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036635:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036641:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036646:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036652:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036657:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036663:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036668:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036684:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036714:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036737:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036744:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036749:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036754:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036759:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036764:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036852:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036861:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036866:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036873:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036887:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036895:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036901:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036906:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036912:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036917:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.036930:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.045265:0:15193:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9650f5d52000:15193] 0 exiting: rc = 1 00000100:00100000:1.0:1788460652.045525:0:15194:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9650f5d53800:15194] 1 exiting: rc = 0 00000100:00100000:0.0:1788460652.045704:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045712:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045718:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045723:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045729:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045734:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045740:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045744:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045749:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045754:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045760:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045764:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045770:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045775:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045780:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045786:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045791:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045810:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045815:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045820:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045825:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045830:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045836:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045841:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045846:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045851:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045855:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045860:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045872:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045879:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045884:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045893:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045898:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045904:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045909:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045913:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045919:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045926:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045932:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045939:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045943:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045949:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045954:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.045962:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046039:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046045:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046051:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046056:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046061:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046066:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046072:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046077:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046093:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046099:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046103:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046109:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046113:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046118:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046124:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046129:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046135:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046140:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046145:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460652.046151:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.050906:0:15195:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9650e6c20c00:15195] 0 exiting: rc = 1 00000100:00100000:0.0:1788460652.054137:0:15196:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9650e88a2400:15196] 1 exiting: rc = 0 00000100:00100000:3.0:1788460652.054331:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054338:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054343:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054349:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054354:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054360:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054365:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054376:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054399:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054406:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054412:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054418:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054424:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054432:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054439:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054460:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054466:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054471:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054477:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054482:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054504:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054512:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054517:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054523:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054529:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054534:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054541:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054549:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054569:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054579:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054588:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054597:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054626:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054646:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054652:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054658:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054663:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054669:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054675:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054692:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054699:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054704:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054709:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054714:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054735:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054743:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054750:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054755:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054760:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054764:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054775:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054781:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054786:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054791:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054796:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054802:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054820:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054826:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054831:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054837:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054844:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054849:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054854:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460652.054861:0:17939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788460652.069378:0:17939:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788460669.190011:0:18554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788460678.401513:0:19016:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788460678.401519:0:19016:0:(obd_mount.c:1014:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788460678.401619:0:19016:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff964fc3bbd800 00000020:01000004:2.0:1788460678.401634:0:19016:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788460678.401642:0:19016:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788460678.401657:0:19016:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9650f5eb0000) 00000020:00000080:2.0:1788460678.401672:0:19016:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788460678.462007:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788460678.465236:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:3.0:1788460678.465635:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788460678.465729:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788460678.465916:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788460678.465993:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1788460678.466086:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1788460678.466206:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1788460678.466308:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788460678.466550:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 513: rc = 0 00100000:10000000:2.0:1788460678.482306:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 457: rc = 0 00100000:10000000:2.0:1788460678.482412:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 457: rc = 0 00100000:10000000:2.0:1788460678.482795:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 651: rc = 0 00100000:10000000:2.0:1788460678.483036:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 651: rc = 0 00100000:10000000:1.0:1788460678.496059:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.497368:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.497639:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.498861:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 651: rc = 0 00100000:10000000:1.0:1788460678.499132:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 651: rc = 0 00100000:10000000:1.0:1788460678.501886:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.502530:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 651: rc = 0 00100000:10000000:1.0:1788460678.503614:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.506419:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 651: rc = 0 00100000:10000000:1.0:1788460678.507840:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 651: rc = 0 00100000:10000000:1.0:1788460678.510293:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 289: rc = 0 00100000:10000000:1.0:1788460678.510574:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 289: rc = 0 00100000:10000000:1.0:1788460678.510828:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 289: rc = 0 00100000:10000000:1.0:1788460678.511118:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 289: rc = 0 00100000:10000000:1.0:1788460678.511400:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 289: rc = 0 00100000:10000000:1.0:1788460678.511671:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 289: rc = 0 00100000:10000000:1.0:1788460678.514152:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 289: rc = 0 00100000:10000000:1.0:1788460678.516382:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 289: rc = 0 00100000:10000000:1.0:1788460678.516638:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 289: rc = 0 00100000:10000000:1.0:1788460678.518170:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 289: rc = 0 00100000:10000000:1.0:1788460678.520786:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 289: rc = 0 00100000:10000000:1.0:1788460678.521118:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 289: rc = 0 00100000:10000000:1.0:1788460678.522981:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 289: rc = 0 00100000:10000000:1.0:1788460678.523960:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 289: rc = 0 00100000:10000000:1.0:1788460678.527714:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 289: rc = 0 00100000:10000000:1.0:1788460678.528117:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 289: rc = 0 00100000:10000000:1.0:1788460678.528546:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 289: rc = 0 00100000:10000000:1.0:1788460678.528807:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 289: rc = 0 00100000:10000000:1.0:1788460678.529056:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 289: rc = 0 00100000:10000000:1.0:1788460678.530128:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 289: rc = 0 00100000:10000000:1.0:1788460678.530502:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 289: rc = 0 00100000:10000000:1.0:1788460678.532501:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 289: rc = 0 00100000:10000000:1.0:1788460678.532889:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 289: rc = 0 00100000:10000000:1.0:1788460678.533145:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 289: rc = 0 00100000:10000000:1.0:1788460678.534641:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 289: rc = 0 00100000:10000000:1.0:1788460678.535636:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 289: rc = 0 00100000:10000000:1.0:1788460678.536137:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 289: rc = 0 00100000:10000000:1.0:1788460678.536643:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 289: rc = 0 00100000:10000000:1.0:1788460678.537028:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 289: rc = 0 00100000:10000000:1.0:1788460678.537609:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 289: rc = 0 00100000:10000000:1.0:1788460678.537945:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 289: rc = 0 00100000:10000000:1.0:1788460678.538452:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 289: rc = 0 00100000:10000000:1.0:1788460678.539688:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 771: rc = 0 00100000:10000000:1.0:1788460678.542084:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1788460678.545098:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 458: rc = 0 00100000:10000000:1.0:1788460678.547669:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1788460678.547761:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 458: rc = 0 00100000:10000000:1.0:1788460678.547975:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1788460678.548044:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 458: rc = 0 00100000:10000000:0.0:1788460678.551646:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788460678.551730:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 461: rc = 0 00100000:10000000:0.0:1788460678.551911:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788460678.551967:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 461: rc = 0 00100000:10000000:0.0:1788460678.552129:0:19016:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788460678.552211:0:19016:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 461: rc = 0 00000020:00000080:0.0:1788460678.552447:0:19016:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788460678.552456:0:19016:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788460678.552466:0:19016:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b891e 00000020:01000004:0.0:1788460678.552474:0:19016:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788460678.552480:0:19016:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788460678.552483:0:19016:0:(tgt_mount.c:115:server_register_mount()) register mount ffff964fc3bbd800 from MGS 00000020:01000004:0.0:1788460678.552487:0:19016:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788460678.552496:0:19016:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9650f5cf4c98) 00000020:00000080:0.0:1788460678.552505:0:19016:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788460678.552551:0:19016:0:(tgt_mount.c:167:server_get_mount()) get mount ffff964fc3bbd800 from MGS, refs=2 00080000:01000000:0.0:1788460678.552554:0:19016:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460678.552558:0:19016:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b892c 00000100:00100000:0.0:1788460678.552641:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788460678.552770:0:19016:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788460678.552776:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788460678.556966:0:19016:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788460678.556981:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788460678.558437:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460678.558617:0:19016:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788460678.558623:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788460678.560071:0:19016:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788460678.560084:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788460678.560638:0:19016:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788460678.560645:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788460678.561225:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460678.561228:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460678.561230:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.561628:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.561631:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.561633:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.562146:0:19016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788460678.569227:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788460678.579669:0:19016:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788460678.579686:0:19016:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788460678.579689:0:19016:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788460678.585144:0:19026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788460678.585367:0:19016:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788460678.585482:0:19016:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788460678.585972:0:19016:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788460678.586309:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460678.586473:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788460678.586479:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788460678.593643:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788460678.593660:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788460678.594018:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788460678.594026:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788460678.594799:0:19016:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788460678.594821:0:19016:0:(obd_mount.c:496:lustre_start_mgc()) Start MGC 'mgc192.168.203.132@tcp' 00000020:01000004:1.0:1788460678.594823:0:19016:0:(obd_mount.c:505:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788460678.594864:0:19016:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD mgc192.168.203.132@tcp (typ=mgc) 00000020:00000080:1.0:1788460678.594875:0:19016:0:(genops.c:413:class_newdev()) Allocate new device mgc192.168.203.132@tcp (ffff964fc1289988) 00000020:00000080:1.0:1788460678.594892:0:19016:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788460678.594967:0:19016:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650fc614800@mgc192.168.203.132@tcp: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1788460678.595127:0:19016:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mgc192.168.203.132@tcp-0 is initialized 00000040:01000000:1.0:1788460678.595133:0:19016:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788460678.597420:0:19032:0:(mgc_request.c:900:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788460678.597473:0:19016:0:(obd_config.c:826:class_setup()) finished setup of obd mgc192.168.203.132@tcp (uuid 13026af2-46ad-415c-9f59-ba32734436e0) 00000020:00000080:3.0:1788460678.597497:0:19016:0:(genops.c:1385:class_connect()) connect: client 13026af2-46ad-415c-9f59-ba32734436e0, cookie 0x889bb893541b893a 00000100:00080000:3.0:1788460678.597509:0:19016:0:(import.c:545:import_select_connection()) mgc192.168.203.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460678.597515:0:19016:0:(import.c:665:import_select_connection()) mgc192.168.203.132@tcp: import ffff9650fc614800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460678.597550:0:19016:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efcfc380 x1875336482642432/t0(0) o250->mgc192.168.203.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460678.597569:0:19016:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import 13026af2-46ad-415c-9f59-ba32734436e0->MGS 00000020:01000004:3.0:1788460678.597587:0:19016:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788460678.597610:0:19016:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788460678.597623:0:19016:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9650f5978000) 00000020:00000080:3.0:1788460678.597634:0:19016:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788460678.601018:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13026af2-46ad-415c-9f59-ba32734436e0:3315:1875336482642432:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788460678.601086:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460678.601206:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642432 00000100:00100000:0.0:1788460678.601214:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642432 00000100:00100000:0.0:1788460678.601245:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460678.601251:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3315:x1875336482642432:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788460678.601277:0:19027:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 13026af2-46ad-415c-9f59-ba32734436e0@0@lo t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:0.0:1788460678.601301:0:19027:0:(genops.c:1385:class_connect()) connect: client 13026af2-46ad-415c-9f59-ba32734436e0, cookie 0x889bb893541b8948 00000100:00080000:0.0:1788460678.601416:0:19027:0:(import.c:65:import_set_state_nolock()) ffff9650c4ecb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460678.601465:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+5:3315:x1875336482642432:12345-0@lo:250:mount.lustre.0 Request processed in 213us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.601472:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460678.601515:0:3315:0:(client.c:3126:ptlrpc_free_committed()) mgc192.168.203.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788460678.601524:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) mgc192.168.203.132@tcp: connect to target with instance 0 00000100:00080000:0.0:1788460678.601531:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) mgc192.168.203.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788460678.601535:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788460678.601544:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650fc614800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788460678.601546:0:3315:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788460678.601556:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788460678.601561:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:13026af2-46ad-415c-9f59-ba32734436e0:3315:1875336482642432:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788460678.601804:0:19030:0:(pinger.c:473:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788460678.620943:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.621142:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788460678.621148:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788460678.623847:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460678.623857:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788460678.624623:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460678.624630:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788460678.625286:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460678.625471:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788460678.625476:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788460678.628609:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788460678.628624:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788460678.694789:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.695112:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788460678.695119:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788460678.696389:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788460678.696399:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788460678.698522:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.699408:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788460678.699417:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788460678.701792:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788460678.701806:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788460678.705329:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.705518:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788460678.705524:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788460678.706340:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788460678.706349:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788460678.707600:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.714478:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788460678.714487:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788460678.715346:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788460678.715355:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788460678.743093:0:19016:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788460678.743576:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788460678.743582:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788460678.745077:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788460678.745089:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788460678.746553:0:19016:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460678.746564:0:19016:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788460678.747756:0:19016:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788460678.747805:0:19016:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788460678.747811:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460678.747812:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460678.747814:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460678.747815:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460678.747817:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460678.747818:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460678.747819:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460678.747821:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460678.747823:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460678.747824:0:19016:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460678.747929:0:19016:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788460678.747932:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460678.747933:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460678.747934:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460678.747935:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460678.747935:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460678.747937:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460678.747937:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460678.747938:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460678.747939:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460678.747940:0:19016:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460678.747977:0:19016:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788460678.747996:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642560:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460678.748066:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.748577:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c3f9c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.749062:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642560 00000100:00100000:2.0:1788460678.749071:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642560 00000100:00100000:2.0:1788460678.749130:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460678.749140:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+5:19016:x1875336482642560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460678.749209:0:19029:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788460678.749216:0:19029:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788460678.749219:0:19029:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788460678.751803:0:19050:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788460678.753075:0:19029:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1788460678.755125:0:19051:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788460678.755131:0:19051:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788460678.755134:0:19051:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788460678.755168:0:19051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788460678.755877:0:19029:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788460678.755888:0:19029:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788460678.771157:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+5:19016:x1875336482642560:12345-0@lo:253:mount.lustre.0 Request processed in 22010us (23083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460678.771174:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460678.771570:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460678.771584:0:19016:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788460678.771587:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460678.771589:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460678.771591:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460678.771592:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460678.771593:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460678.771595:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460678.771596:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460678.771598:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460678.771599:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460678.771600:0:19016:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460678.771620:0:19016:0:(tgt_mount.c:115:server_register_mount()) register mount ffff964fc3bbd800 from lustre-MDT0000 10000000:01000000:2.0:1788460678.771781:0:19016:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788460678.771784:0:19016:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788460678.771788:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.771794:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460678.771811:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff964fc3bbd800 from 1 10000000:01000000:2.0:1788460678.771814:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788460678.771862:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.771872:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.771882:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.771901:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460678.771942:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.772031:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460678.772074:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642688 00000100:00100000:0.0:1788460678.772082:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642688 00000100:00100000:0.0:1788460678.772485:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460678.772496:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+5:19016:x1875336482642688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460678.772511:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460678.772527:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea4e00/0x889bb893541b8956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b894f expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.772550:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea4e00/0x889bb893541b8956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b894f expref: 6 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.772559:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea4e00/0x889bb893541b8956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b894f expref: 6 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.772568:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4e00, rc 0) 00000100:00100000:0.0:1788460678.772658:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+6:19016:x1875336482642688:12345-0@lo:101:mount.lustre.0 Request processed in 165us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.772665:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460678.772887:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.772902:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8956 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.772911:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8956 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.772949:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460678.772976:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.773043:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460678.773078:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642816 00000100:00100000:3.0:1788460678.773083:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642816 00000100:00100000:3.0:1788460678.773535:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460678.773545:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+6:19016:x1875336482642816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460678.773989:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+6:19016:x1875336482642816:12345-0@lo:501:mount.lustre.0 Request processed in 446us (1011us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460678.773997:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460678.774082:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642816:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460678.774108:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788460678.774125:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8956 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.774134:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009a00/0x889bb893541b894f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8956 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460678.774143:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.774149:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788460678.774169:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.774172:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788460678.774198:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff964fc3bbd800 from 1 10000000:01000000:2.0:1788460678.774201:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788460678.774226:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.774235:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.774542:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.774563:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642944:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460678.774595:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460678.774736:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482642944 00000100:00100000:1.0:1788460678.774743:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482642944 00000100:00100000:1.0:1788460678.774782:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460678.774789:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+6:19016:x1875336482642944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460678.774799:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460678.774813:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5200/0x889bb893541b8964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b895d expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.774841:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5200/0x889bb893541b8964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b895d expref: 7 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.774851:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5200/0x889bb893541b8964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b895d expref: 7 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.774858:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5200, rc 0) 00000100:00100000:1.0:1788460678.774884:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+7:19016:x1875336482642944:12345-0@lo:101:mount.lustre.0 Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460678.774890:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460678.775024:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.775038:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482642944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.775049:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8964 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.775057:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8964 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460678.775068:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788460678.775123:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8964 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.775131:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008a00/0x889bb893541b895d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8964 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460678.775138:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788460678.775143:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460678.775161:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.775164:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788460678.775173:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788460678.775195:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788460678.775213:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.775228:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.775237:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.775261:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643072:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460678.775459:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.775481:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460678.775601:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643072 00000100:00100000:1.0:1788460678.775605:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643072 00000100:00100000:1.0:1788460678.775648:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460678.775655:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+7:19016:x1875336482643072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460678.775672:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460678.775681:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b8972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b896b expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.775696:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b8972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b896b expref: 8 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.775703:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5a00/0x889bb893541b8972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b896b expref: 8 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460678.775719:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5a00, rc 0) 00000100:00100000:1.0:1788460678.775751:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+8:19016:x1875336482643072:12345-0@lo:101:mount.lustre.0 Request processed in 96us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460678.775757:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460678.775963:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643072:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.775975:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8972 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.775982:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8972 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.776013:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460678.776037:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.776064:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460678.776139:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643200 00000100:00100000:3.0:1788460678.776143:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643200 00000100:00100000:3.0:1788460678.776166:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460678.776172:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+8:19016:x1875336482643200:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460678.778667:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+9:19016:x1875336482643200:12345-0@lo:501:mount.lustre.0 Request processed in 2488us (2622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460678.778681:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460678.779796:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460678.779891:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460678.779954:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.780031:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460678.780499:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643328 00000100:00100000:0.0:1788460678.780507:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643328 00000100:00100000:0.0:1788460678.780597:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460678.780605:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+9:19016:x1875336482643328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460678.780977:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+9:19016:x1875336482643328:12345-0@lo:503:mount.lustre.0 Request processed in 372us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.780985:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460678.781074:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460678.781825:0:19052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19052:1875336482643456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460678.781883:0:19052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460678.782470:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643456 00000100:00100000:1.0:1788460678.782476:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643456 00000100:00100000:1.0:1788460678.782506:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460678.782514:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+9:19052:x1875336482643456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460678.782788:0:19052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460678.783167:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+9:19052:x1875336482643456:12345-0@lo:502:llog_process_th.0 Request processed in 651us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460678.783176:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460678.783468:0:19052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19052:1875336482643456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460678.783499:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460678.783509:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.783512:0:19052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460678.783518:0:19052:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788460678.783522:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460678.783535:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9650f5eb3310) 00000020:00000080:2.0:1788460678.783554:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788460678.783559:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788460678.783797:0:19052:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788460678.783805:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b8980 00000020:00000080:2.0:1788460678.784021:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788460678.784025:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460678.784029:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.784031:0:19052:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460678.784034:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460678.784037:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.784038:0:19052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788460678.784041:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460678.784048:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9650f5eb4c98) 00000020:00000080:2.0:1788460678.784057:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788460678.784061:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788460678.784063:0:19052:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788460678.784066:0:19052:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788460678.784072:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788460678.784510:0:19052:0:(tgt_mount.c:167:server_get_mount()) get mount ffff964fc3bbd800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788460678.784525:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9650f5eb6620) 00000020:00000080:2.0:1788460678.784537:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788460678.784583:0:19052:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788460678.784596:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8995 00000020:00000080:2.0:1788460678.784915:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788460678.784922:0:19052:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788460678.784927:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x889bb893541b899c 00080000:01000000:2.0:1788460678.784932:0:19052:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788460678.784935:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b89a3 00010000:00010000:2.0:1788460678.917836:0:19052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788460678.920156:0:19052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1788460678.921550:0:19052:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788460678.923612:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9650f5eb1988) 00000020:00000080:2.0:1788460678.923635:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788460678.923921:0:19052:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788460678.923931:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b89b1 00000020:00000080:3.0:1788460678.933562:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788460678.940119:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x889bb893541b89b8 00000020:00000080:0.0:1788460678.949514:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788460678.949534:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460678.949549:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460678.949552:0:19052:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788460678.949556:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460678.949584:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460678.949586:0:19052:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788460678.949592:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788460678.949639:0:19052:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788460678.949663:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460678.949667:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460678.949668:0:19052:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788460678.949682:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460678.949697:0:19052:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788460678.949699:0:19052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460678.949700:0:19052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460678.949702:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460678.949977:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460678.949980:0:19052:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460678.949984:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460678.949987:0:19052:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788460678.949992:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460678.949993:0:19052:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788460678.949996:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460678.950001:0:19052:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:1.0:1788460678.950028:0:19052:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788460678.950031:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460678.950047:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff964fc1288000) 00000020:00000080:1.0:1788460678.950064:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788460678.950070:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460678.950644:0:19052:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788460678.950651:0:19052:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788460678.950658:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b89c6 00010000:00080000:1.0:1788460678.950691:0:19052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650ea76b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:1.0:1788460678.954917:0:19052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788460678.955407:0:19052:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788460678.955469:0:19052:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788460678.960746:0:19052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460678.960805:0:19052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788460678.960905:0:19052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788460678.966370:0:19056:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788460678.966379:0:19056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788460678.967175:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460678.967214:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788460678.967412:0:19052:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788460678.967437:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b89cd 00000100:00080000:2.0:1788460678.967448:0:19052:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460678.967454:0:19052:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650ea76b800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460678.967490:0:19052:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc44e00 x1875336482643584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460678.967626:0:19052:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788460678.967747:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460678.967751:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.967753:0:19052:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788460678.967757:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788460678.967760:0:19052:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788460678.967761:0:19052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460678.967763:0:19052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460678.967764:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788460678.967767:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.967781:0:19052:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788460678.967786:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788460678.967789:0:19052:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788460678.967793:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.967794:0:19052:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000100:00100000:0.0:1788460678.967796:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482643584:0@lo:8:llog_process_th.0 00000020:00000080:2.0:1788460678.967797:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788460678.967801:0:19052:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.132@tcp to nid 0x20000c0a8cb84 (192.168.203.132@tcp) 00000020:01000000:2.0:1788460678.967822:0:19052:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788460678.967824:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460678.967857:0:19052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9650c786cc98) 00000400:00000100:0.0:1788460678.967857:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482643584 offset 0 length 520: 4 00000020:00000080:2.0:1788460678.967869:0:19052:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788460678.967874:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788460678.967930:0:19052:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788460678.967936:0:19052:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788460678.967942:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x889bb893541b89db 00010000:00080000:2.0:1788460678.967970:0:19052:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650c511e800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460678.968218:0:19052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788460678.968415:0:19052:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788460678.968435:0:19052:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788460678.968961:0:19052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460678.969023:0:19052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788460678.969090:0:19052:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788460678.969853:0:19058:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788460678.969858:0:19058:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788460678.970808:0:19052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788460678.970819:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788460678.970859:0:19052:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788460678.970878:0:19052:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b89e2 00000100:00080000:2.0:1788460678.970888:0:19052:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460678.970894:0:19052:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c511e800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460678.970925:0:19052:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc47800 x1875336482643712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460678.970959:0:19052:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788460678.971014:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460678.971017:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.971019:0:19052:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788460678.971022:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460678.971026:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.971027:0:19052:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788460678.971031:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788460678.971032:0:19052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788460678.971035:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460678.971037:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.971038:0:19052:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788460678.971040:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460678.971042:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.971044:0:19052:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788460678.971047:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788460678.971077:0:19052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19052:1875336482643840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460678.971146:0:19052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460678.971204:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643840 00000100:00100000:1.0:1788460678.971212:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643840 00000100:00100000:2.0:1788460678.971213:0:19052:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460678.971260:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460678.971269:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+9:19052:x1875336482643840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460678.971506:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+9:19052:x1875336482643840:12345-0@lo:502:llog_process_th.0 Request processed in 237us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460678.971521:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460678.972033:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482643712:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788460678.972075:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482643712 offset 0 length 520: 4 00000100:00100000:2.0:1788460678.972862:0:19052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19052:1875336482643840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460678.972897:0:19052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460678.972905:0:19052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460678.972907:0:19052:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460678.972913:0:19052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788460678.976267:0:19016:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788460678.976285:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788460678.976308:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8972 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.976321:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009400/0x889bb893541b896b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8972 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460678.976329:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc3bbd800 from 1 10000000:01000000:3.0:1788460678.976332:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460678.976377:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.976386:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.976396:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460678.976420:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460678.976482:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.976561:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8944f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.978872:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482643968 00000100:00100000:2.0:1788460678.978885:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482643968 00000100:00100000:2.0:1788460678.978987:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460678.978997:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+9:19016:x1875336482643968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.979013:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460678.979045:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008000/0x889bb893541b89f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b89e9 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.979070:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008000/0x889bb893541b89f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b89e9 expref: 10 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.979081:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008000/0x889bb893541b89f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b89e9 expref: 10 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.979089:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460678.979167:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482643968:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460678.979174:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460678.979292:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482643968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460678.979310:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.979339:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460678.979930:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644096:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788460678.979981:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.980887:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8944f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460678.980963:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644096 00000100:00100000:0.0:1788460678.980971:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644096 00000100:00100000:0.0:1788460678.981012:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460678.981021:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644096:12345-0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788460678.981091:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644096:12345-0@lo:256:mount.lustre.0 Request processed in 71us (1109us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788460678.981099:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788460678.981247:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644096:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788460678.983998:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' failed (-11). 00010000:00010000:3.0:1788460678.984023:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984035:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460678.984043:0:19016:0:(mgc_request.c:2375:mgc_process_log()) mgc192.168.203.132@tcp: IR log lustre-mdtir not ready yet: rc = -11 00010000:00010000:3.0:1788460678.984050:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984056:0:19016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984062:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984068:0:19016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984105:0:19016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788460678.984124:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff964fc3bbd800 from 1 10000000:01000000:3.0:1788460678.984128:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460678.984164:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984172:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.984206:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460678.984232:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460678.984300:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460678.984554:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460678.984562:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.984570:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5000 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460678.984581:0:19023:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.984590:0:19023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460678.984598:0:19023:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460678.984755:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89446c0 going to sleep for 11 seconds 10000000:01000000:0.0:1788460678.984819:0:19023:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460678.984863:0:19023:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.984870:0:19023:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460678.984889:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.984896:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5000/0x889bb893541b89e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x889bb893541b89f0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.984914:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.984916:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460678.984917:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460678.985134:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482644352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460678.985171:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460678.985257:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644224 00000100:00100000:0.0:1788460678.985264:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644224 00000100:00100000:0.0:1788460678.985300:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460678.985308:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644224:12345-0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460678.985453:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644352 00000100:00100000:3.0:1788460678.985457:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644352 00000100:00100000:3.0:1788460678.985488:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460678.985495:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+11:3319:x1875336482644352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460678.985506:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460678.985519:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008000/0x889bb893541b89f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x889bb893541b89e9 expref: 11 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.985537:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460678.985573:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+10:3319:x1875336482644352:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460678.985580:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460678.985888:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482644352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460678.985935:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460678.985958:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b89f7 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.985976:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b89f7 expref: 10 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.985987:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b89f7 expref: 10 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460678.985994:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5400, rc 0) 00000100:00100000:0.0:1788460678.986045:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644224:12345-0@lo:101:mount.lustre.0 Request processed in 738us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.986051:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460678.986117:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460678.986132:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460678.986141:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460678.986175:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460678.986232:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.986257:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.988194:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644480 00000100:00100000:2.0:1788460678.988210:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644480 00000100:00100000:2.0:1788460678.988279:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460678.988289:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460678.988730:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644480:12345-0@lo:501:mount.lustre.0 Request processed in 441us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460678.988738:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460678.988930:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460678.988978:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460678.989024:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.989060:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e89446c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460678.989142:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644608 00000100:00100000:0.0:1788460678.989147:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644608 00000100:00100000:0.0:1788460678.989173:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460678.989202:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460678.989348:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644608:12345-0@lo:503:mount.lustre.0 Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.989355:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460678.989450:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460678.990869:0:19060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19060:1875336482644736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460678.990938:0:19060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.990981:0:19060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8944c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460678.991159:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644736 00000100:00100000:0.0:1788460678.991165:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644736 00000100:00100000:0.0:1788460678.991229:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460678.991238:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19060:x1875336482644736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460678.991473:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+10:19060:x1875336482644736:12345-0@lo:502:llog_process_th.0 Request processed in 236us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460678.991480:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460678.991568:0:19060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19060:1875336482644736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788460678.991597:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460678.991617:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.991620:0:19060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788460678.991635:0:19060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff964fc3bbd800 00000020:00000080:3.0:1788460678.991637:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460678.991645:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460678.991653:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.991655:0:19060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788460678.991658:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460678.991660:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.991661:0:19060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788460678.991665:0:19060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff964fc3bbd800 00000020:00000080:3.0:1788460678.991667:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460678.991721:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460678.991724:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.991726:0:19060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788460678.991728:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460678.991730:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.991731:0:19060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460678.991735:0:19060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff964fc3bbd800 00000020:00000080:3.0:1788460678.991737:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788460678.991769:0:19060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19060:1875336482644864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460678.991803:0:19060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460678.991816:0:19060:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8944c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.992897:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644864 00000100:00100000:2.0:1788460678.992907:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644864 00000100:00100000:2.0:1788460678.992944:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788460678.992952:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19060:x1875336482644864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460678.993172:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19060:x1875336482644864:12345-0@lo:502:llog_process_th.0 Request processed in 220us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460678.993210:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460678.993763:0:19060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19060:1875336482644864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788460678.993799:0:19060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460678.993806:0:19060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460678.993808:0:19060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788460678.993812:0:19060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788460678.994290:0:19016:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788460678.994307:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460678.994328:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.994339:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460678.994382:0:19016:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788460678.994386:0:19016:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.994389:0:19016:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff964fc3bbd800 10000000:01000000:2.0:1788460678.994393:0:19016:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460678.994410:0:19016:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff964fc3bbd800 from 1 10000000:01000000:2.0:1788460678.994413:0:19016:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788460678.994447:0:19016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.994456:0:19016:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.994466:0:19016:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.994487:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460678.994534:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.994568:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.994585:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482644992 00000100:00100000:2.0:1788460678.994590:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482644992 00000100:00100000:2.0:1788460678.997056:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460678.997075:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+10:19016:x1875336482644992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.997093:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460678.997124:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008200/0x889bb893541b8a0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a05 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.997154:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008200/0x889bb893541b8a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a05 expref: 11 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.997165:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008200/0x889bb893541b8a0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a05 expref: 11 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.997173:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008200, rc 0) 00000100:00100000:2.0:1788460678.997269:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482644992:12345-0@lo:101:mount.lustre.0 Request processed in 202us (2734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460678.997276:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460678.997367:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482644992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460678.997385:0:19016:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a0c expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460678.997395:0:19016:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a0c expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460678.997446:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460678.997480:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460678.997511:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460678.997526:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645120 00000100:00100000:2.0:1788460678.997533:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645120 00000100:00100000:2.0:1788460678.997556:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460678.997561:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460679.000044:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645120:12345-0@lo:501:mount.lustre.0 Request processed in 2475us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460679.000063:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460679.000126:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460679.000171:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460679.000232:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460679.000261:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460679.000324:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645248 00000100:00100000:1.0:1788460679.000332:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645248 00000100:00100000:1.0:1788460679.000373:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460679.000381:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460679.000524:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645248:12345-0@lo:503:mount.lustre.0 Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460679.000530:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788460679.003893:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460679.006334:0:19062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19062:1875336482645376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460679.006425:0:19062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460679.006465:0:19062:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea59be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460679.008149:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645376 00000100:00100000:2.0:1788460679.008162:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645376 00000100:00100000:2.0:1788460679.008230:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460679.008240:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+11:19062:x1875336482645376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460679.008542:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+11:19062:x1875336482645376:12345-0@lo:502:llog_process_th.0 Request processed in 304us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460679.008551:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460679.008707:0:19062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19062:1875336482645376:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788460679.008777:0:19062:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788460679.008793:0:19062:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9650c7869988) 00000020:00000080:2.0:1788460679.008811:0:19062:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788460679.008918:0:19062:0:(tgt_mount.c:167:server_get_mount()) get mount ffff964fc3bbd800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788460679.008922:0:19062:0:(tgt_mount.c:201:server_put_mount()) put mount ffff964fc3bbd800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788460679.008926:0:19062:0:(obd_mount.c:798:lustre_put_lsi()) put ffff964fc3bbd800 4 00010000:00080000:2.0:1788460679.008960:0:19062:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650d0bf1800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460679.015110:0:19062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788460679.015460:0:19062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788460679.015501:0:19062:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460679.015516:0:19062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x889bb893541b8a1a 00000100:00080000:2.0:1788460679.015534:0:19062:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460679.015540:0:19062:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9650d0bf1800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460679.015575:0:19062:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc46d80 x1875336482645504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460679.015596:0:19062:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788460679.016305:0:19062:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19062:1875336482645632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460679.016572:0:19062:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460679.016613:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645632 00000100:00100000:2.0:1788460679.016619:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645632 00000100:00100000:2.0:1788460679.016714:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460679.016723:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19062:x1875336482645632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460679.016981:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19062:x1875336482645632:12345-0@lo:502:llog_process_th.0 Request processed in 258us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460679.016988:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460679.017041:0:19062:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460679.017063:0:19062:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:13026af2-46ad-415c-9f59-ba32734436e0:19062:1875336482645632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788460679.017096:0:19062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788460679.017149:0:19016:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788460679.017159:0:19016:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788460679.017210:0:19016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a0c expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.017221:0:19016:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009200/0x889bb893541b8a05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a0c expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788460679.017265:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788460679.017271:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460679.017272:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460679.017273:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460679.017274:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460679.017276:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460679.017277:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460679.017278:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460679.017280:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460679.017281:0:19016:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460679.017284:0:19016:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788460679.017287:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460679.017288:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460679.017289:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460679.017289:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460679.017290:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460679.017292:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460679.017292:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460679.017293:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460679.017294:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460679.017295:0:19016:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460679.017310:0:19016:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788460679.017701:0:19016:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645760:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460679.017740:0:19016:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460679.017766:0:19016:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788460679.017795:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645760 00000100:00100000:2.0:1788460679.017800:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645760 00000100:00100000:2.0:1788460679.017827:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460679.017847:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460679.017869:0:19027:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788460679.017881:0:19027:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788460679.021171:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482645504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460679.021255:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460679.022145:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645504 00000100:00100000:1.0:1788460679.022157:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645504 00000100:00100000:1.0:1788460679.022549:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460679.022558:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482645504:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460679.022745:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482645504:12345-0@lo:38:llog_process_th.0 Request processed in 186us (1489us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788460679.022753:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460679.025118:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460679.025131:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460679.025137:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788460679.025142:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482645504:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788460679.102249:0:19027:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788460679.102264:0:19027:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788460679.102508:0:19050:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788460679.102513:0:19050:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788460679.102543:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102560:0:19050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788460679.102583:0:19050:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000071128s 00010000:00010000:2.0:1788460679.102588:0:19050:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102595:0:19050:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102602:0:19050:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102610:0:19050:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102616:0:19050:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460679.102628:0:19050:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102638:0:19050:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102650:0:19050:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102657:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460679.102663:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009e00/0x889bb893541b8a21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460679.120687:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:19016:x1875336482645760:12345-0@lo:253:mount.lustre.0 Request processed in 102832us (102937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460679.120711:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460679.120918:0:19016:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19016:1875336482645760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460679.120945:0:19016:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788460679.120949:0:19016:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460679.120950:0:19016:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460679.120952:0:19016:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460679.120953:0:19016:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460679.120954:0:19016:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460679.120955:0:19016:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460679.120956:0:19016:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460679.120957:0:19016:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460679.120959:0:19016:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460679.120961:0:19016:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788460679.120975:0:19016:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788460679.132657:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460679.133037:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460679.133489:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460679.133696:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460679.133992:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460679.134165:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460679.137052:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460679.137909:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460679.138401:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460679.138707:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460679.139049:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460679.140018:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788460679.187035:0:19016:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:3.0:1788460679.187592:0:19016:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788460679.188058:0:19073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788460679.188146:0:19073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460679.193611:0:19073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788460679.193678:0:19073:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788460679.193682:0:19073:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788460679.194411:0:19016:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788460679.194550:0:19016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788460679.194934:0:19072:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:0.0:1788460679.194939:0:19072:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000004:00000080:1.0:1788460679.195360:0:19016:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788460679.195370:0:19016:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788460679.195529:0:19016:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460679.197686:0:19016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788460679.198526:0:19016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788460679.198567:0:19016:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788460679.199495:0:19016:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788460679.201053:0:19016:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788460679.219978:0:19016:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1788460679.255359:0:19016:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788460679.255397:0:19016:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa77dc1c7f9b8 00100000:10000000:3.0:1788460679.255405:0:19016:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788460679.256488:0:19016:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788460679.256517:0:19016:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788460679.583993:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460680.142681:0:19069:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460680.142690:0:19069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460680.143054:0:19069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788460680.143060:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1788460680.208504:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788460680.208510:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc3bbd800 from 1 10000000:01000000:0.0:1788460680.208516:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460680.208561:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460680.208572:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460680.208583:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460680.208606:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482645888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460680.208672:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460680.208729:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c92a0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788460680.209014:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482645888 00000100:00100000:3.0:1788460680.209022:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482645888 00000100:00100000:3.0:1788460680.209078:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788460680.209088:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+11:19032:x1875336482645888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460680.209102:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460680.209117:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a28 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460680.209138:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a28 expref: 12 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460680.209149:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a28 expref: 12 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460680.209327:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4600, rc 0) 00000100:00100000:3.0:1788460680.209473:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482645888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 386us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460680.209489:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460680.223107:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482645888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460680.223137:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460680.223150:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460680.223944:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482646016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460680.224009:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460680.224063:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d194b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460680.224175:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646016 00000100:00100000:0.0:1788460680.224198:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646016 00000100:00100000:0.0:1788460680.224256:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460680.224278:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482646016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460680.224298:0:19027:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788460680.224314:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788460680.224318:0:19027:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788460680.224415:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482646016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460680.224423:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460680.225213:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482646016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788460680.226899:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460680.226914:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460680.226928:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460680.588477:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460681.174413:0:19069:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788460681.174421:0:19069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460681.175283:0:19069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788460681.175350:0:19069:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460681.175385:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1788460681.617789:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460682.641840:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460683.661324:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460684.308140:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460684.308149:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460684.308152:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460684.308154:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460684.308157:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788460684.308161:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788460684.308164:0:36:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf1800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460684.308175:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9650d0bf1800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460684.308228:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d108c000 x1875336482646272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460684.308287:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482646144:0@lo:400:kworker.0 00000100:00100000:1.0:1788460684.308350:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460684.308457:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482646272:0@lo:38:kworker.0 00000100:00100000:2.0:1788460684.308526:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460684.308606:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646272 00000100:00100000:1.0:1788460684.308612:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646272 00000100:00100000:1.0:1788460684.308646:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460684.308652:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875336482646272:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788460684.308682:0:19035:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:1.0:1788460684.308714:0:19035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x889bb893541b8a36 00000004:00100000:1.0:1788460684.308735:0:19035:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788460684.308927:0:19035:0:(import.c:65:import_set_state_nolock()) ffff965101d81800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460684.308973:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875336482646272:12345-0@lo:38:kworker.0 Request processed in 319us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460684.308980:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788460684.309013:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650d108c000 x1875336482646272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460684.309028:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788460684.309034:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788460684.309038:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788460684.309040:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650d0bf1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788460684.309045:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875336482646272:0@lo:38:kworker.0 00000100:00100000:2.0:1788460684.309221:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646144 00000100:00100000:2.0:1788460684.309226:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646144 00000100:00100000:2.0:1788460684.309259:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788460684.309265:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:3316:x1875336482646144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460684.309300:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:3316:x1875336482646144:12345-0@lo:400:kworker.0 Request processed in 35us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460684.309306:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460684.312834:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482646144:0@lo:400:kworker.0 00000001:02000400:3.0:1788460684.341570:0:19316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788460684.684535:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460685.708286:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460686.732462:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460687.540450:0:19468:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7e161c00 20000000:00000080:2.0:1788460687.540467:0:19468:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9650c7960c00 uarg=0000000000000000 20000000:01000000:2.0:1788460687.540501:0:19468:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788460687.540508:0:19468:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788460687.540512:0:19468:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788460687.541445:0:19469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788460687.544394:0:19468:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788460687.553171:0:19468:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460687.553595:0:19468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.553615:0:19468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b89f7 expref: 11 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.553634:0:19468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.553687:0:19468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 11 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.553703:0:19468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 11 pid: 19028 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460687.553716:0:19468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19468:1875336482646400:0@lo:104: 00000100:00100000:2.0:1788460687.553787:0:19468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460687.553849:0:19468:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3333c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460687.554231:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646400 00000100:00100000:3.0:1788460687.554240:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646400 00000100:00100000:3.0:1788460687.554311:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460687.554322:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+3:19468:x1875336482646400:12345-0@lo:104: 00010000:00010000:3.0:1788460687.554337:0:19017:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554407:0:19017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460687.554413:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+3:19468:x1875336482646400:12345-0@lo:104: Request processed in 95us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460687.554420:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788460687.554441:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460687.554447:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554456:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5200 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460687.554459:0:19022:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554469:0:19022:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460687.554475:0:19468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19468:1875336482646400:0@lo:104: 10000000:00010000:3.0:1788460687.554492:0:19022:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.554497:0:19468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460687.554498:0:19022:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460687.554534:0:19022:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554541:0:19022:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460687.554568:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554576:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b89f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b89fe expref: -99 pid: 19016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554592:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460687.554593:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460687.554595:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460687.554610:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460687.554620:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482646528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460687.554664:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460687.554696:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646528 00000100:00100000:3.0:1788460687.554699:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646528 00010000:00010000:3.0:1788460687.554715:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 12 pid: 19028 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460687.554748:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460687.554755:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+12:3316:x1875336482646528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460687.554764:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460687.554785:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 12 pid: 19028 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554796:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 12 pid: 19028 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554809:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea5400/0x889bb893541b89fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b89f7 expref: 12 pid: 19028 timeout: 660 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554821:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554829:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554843:0:19019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554860:0:19019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554866:0:19019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554872:0:19019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554877:0:19019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460687.554881:0:19019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554896:0:19019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554915:0:19019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.554924:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460687.554954:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+11:3316:x1875336482646528:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460687.554960:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460687.554988:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482646528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460687.555211:0:19468:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.555221:0:19468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460687.555227:0:19468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec009800/0x889bb893541b8a3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460687.759134:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460688.396369:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460678/real 1788460678] req@ffff9650efc47800 x1875336482643712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460688.396406:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650efc47800 x1875336482643712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460688.396416:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460678/real 1788460678] req@ffff9650efc44e00 x1875336482643584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460688 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460688.396427:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650efc44e00 x1875336482643584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460688 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788460688.396444:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460688.396481:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788460688.396485:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482643712:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788460688.396491:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650ea76b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460688.396496:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788460688.396499:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482643584:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788460688.396750:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460688.396755:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788460688.396758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9650ea76b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460688.396771:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1788460688.396776:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788460688.396783:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650ea76b800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460688.396803:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650fd3c6680 x1875336482646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460688.396820:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460688.396823:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788460688.396825:0:37:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460688.396828:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 552 00000100:00080000:0.0:1788460688.396831:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788460688.396833:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c511e800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460688.396843:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650fd3c4380 x1875336482646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460688.396981:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482646656:0@lo:400:kworker.0 00000100:00100000:3.0:1788460688.397076:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460688.397153:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460688.397159:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482647040:0@lo:400:kworker.0 00000100:00100000:3.0:1788460688.397214:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460688.397264:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647040 00000100:00100000:3.0:1788460688.397271:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647040 00000100:00100000:3.0:1788460688.397308:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460688.397316:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482647040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460688.397359:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482647040:12345-0@lo:400:kworker.0 Request processed in 44us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460688.397366:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788460688.397398:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650fd3c7800 x1875336482647040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460704 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460688.397409:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482647040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460688.398390:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482646784:0@lo:8:kworker.0 00000400:00000100:2.0:1788460688.398434:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482646784 offset 0 length 520: 4 00000100:00100000:2.0:1788460688.398475:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482646912:0@lo:8:kworker.0 00000400:00000100:2.0:1788460688.398505:0:3315:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336482646912 offset 0 length 520: 4 00000100:00100000:0.0:1788460688.398804:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482646656 00000100:00100000:0.0:1788460688.398818:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482646656 00000100:00100000:1.0:1788460688.401403:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460688.401416:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:3318:x1875336482646656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460688.401514:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+11:3318:x1875336482646656:12345-0@lo:400:kworker.0 Request processed in 101us (4438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460688.401521:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788460688.401606:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482646656:0@lo:400:kworker.0 00010000:00010000:1.0:1788460688.782944:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788460688.972379:0:19032:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460688.972387:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff964fc3bbd800 from 10 10000000:01000000:1.0:1788460688.972393:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460688.972440:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460688.972470:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460688.972480:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460688.972503:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460688.972568:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460688.972623:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460688.973194:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647168 00000100:00100000:2.0:1788460688.973204:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647168 00000100:00100000:2.0:1788460688.973253:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788460688.973264:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+11:19032:x1875336482647168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460688.973278:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460688.973293:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a44 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460688.973317:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a44 expref: 12 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460688.973328:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a44 expref: 12 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460688.973338:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008000, rc 0) 00000100:00100000:2.0:1788460688.973405:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482647168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460688.973412:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788460688.973814:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460688.973829:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460688.973839:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460688.973881:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460688.973911:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460688.973949:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460688.974782:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647296 00000100:00100000:2.0:1788460688.974791:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647296 00000100:00100000:2.0:1788460688.974839:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460688.974848:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482647296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460688.975108:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482647296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460688.975116:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460688.975217:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460688.975257:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460688.975300:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460688.975335:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c30ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460688.975398:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647424 00000100:00100000:0.0:1788460688.975402:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647424 00000100:00100000:0.0:1788460688.975434:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788460688.975440:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482647424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460688.975586:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:19032:x1875336482647424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460688.975593:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788460688.975785:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482647424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460688.976727:0:19529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788460688.982647:0:19032:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788460688.982667:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460688.982697:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460688.982709:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460689.805881:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460690.830012:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460691.406503:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788460691.854326:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788460692.561340:0:19718:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788460692.561343:0:19718:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788460692.561452:0:19718:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9650f5c67000 00000020:01000004:2.0:1788460692.561466:0:19718:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788460692.561478:0:19718:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788460692.561492:0:19718:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9650c7868000) 00000020:00000080:2.0:1788460692.561508:0:19718:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788460692.577449:0:19718:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788460692.577995:0:19718:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788460692.579307:0:19718:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788460692.579594:0:19718:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788460692.580341:0:19718:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:0.0:1788460692.581080:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788460692.581268:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788460692.581330:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788460692.582344:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 239: rc = 0 00100000:10000000:0.0:1788460692.582871:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 239: rc = 0 00100000:10000000:0.0:1788460692.583370:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 239: rc = 0 00100000:10000000:1.0:1788460692.584721:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 239: rc = 0 00100000:10000000:1.0:1788460692.584977:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 239: rc = 0 00100000:10000000:1.0:1788460692.585264:0:19718:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 239: rc = 0 00000020:00000080:1.0:1788460692.586562:0:19718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788460692.586572:0:19718:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788460692.586588:0:19718:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b8a59 00000020:01000004:1.0:1788460692.586597:0:19718:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788460692.586628:0:19718:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788460692.586632:0:19718:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788460692.586638:0:19718:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788460692.586642:0:19718:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788460692.586653:0:19718:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff964fc128e620) 00000020:00000080:1.0:1788460692.586663:0:19718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788460692.587809:0:19718:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460692.587972:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788460692.587979:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788460692.591480:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788460692.591494:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788460692.596239:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788460692.596250:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788460692.598308:0:19718:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460692.598598:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788460692.598603:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788460692.599087:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788460692.599093:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788460692.616502:0:19718:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460692.624291:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788460692.624520:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788460692.626477:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460692.626492:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788460692.627929:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788460692.627941:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788460692.631083:0:19718:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460692.631426:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788460692.631432:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788460692.632073:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788460692.632081:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788460692.682372:0:19718:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460692.682557:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788460692.682577:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788460692.683965:0:19718:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788460692.683979:0:19718:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788460692.684692:0:19718:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788460692.684754:0:19718:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.132@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788460692.684759:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788460692.684761:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460692.684762:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460692.684764:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460692.684765:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460692.684767:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460692.684768:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460692.684770:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460692.684772:0:19718:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788460692.684776:0:19718:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788460692.684778:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460692.684779:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460692.684780:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460692.684781:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460692.684782:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460692.684784:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460692.684785:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460692.684786:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460692.684787:0:19718:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788460692.684863:0:19718:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788460692.684884:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647552:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788460692.684954:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.685036:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.685295:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647552 00000100:00100000:2.0:1788460692.685304:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647552 00000100:00100000:2.0:1788460692.685389:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460692.685398:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:19718:x1875336482647552:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460692.685426:0:19028:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788460692.685429:0:19028:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788460692.685433:0:19028:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788460692.700599:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+12:19718:x1875336482647552:12345-0@lo:253:mount.lustre.0 Request processed in 15193us (15636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.700622:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460692.703747:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647552:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788460692.703788:0:19718:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788460692.703792:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460692.703793:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460692.703795:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460692.703796:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460692.703797:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460692.703799:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460692.703800:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460692.703802:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460692.703804:0:19718:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460692.704205:0:19718:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650f5c67000 from lustre-OST0000 10000000:01000000:2.0:1788460692.704237:0:19718:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788460692.704241:0:19718:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788460692.704246:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650f5c67000 10000000:01000000:2.0:1788460692.704251:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460692.704268:0:19718:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788460692.712950:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460692.719957:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460692.719976:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650f5c67000 from 1 10000000:01000000:1.0:1788460692.719980:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788460692.720021:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.720031:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.720042:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460692.720066:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460692.720130:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.720325:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f59060c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.720508:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647680 00000100:00100000:2.0:1788460692.720515:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647680 00000100:00100000:2.0:1788460692.720594:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460692.720603:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+12:19718:x1875336482647680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460692.720622:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460692.720635:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008800/0x889bb893541b8a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a67 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.720668:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008800/0x889bb893541b8a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a67 expref: 13 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.720679:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008800/0x889bb893541b8a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a67 expref: 13 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.720949:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008800, rc 0) 00000100:00100000:2.0:1788460692.721006:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482647680:12345-0@lo:101:mount.lustre.0 Request processed in 404us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.721012:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788460692.721125:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460692.721143:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a6e expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.721154:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a6e expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.721356:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460692.721384:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460692.721416:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3053a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.722914:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647808 00000100:00100000:2.0:1788460692.722926:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647808 00000100:00100000:2.0:1788460692.722976:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460692.722984:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482647808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460692.723233:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482647808:12345-0@lo:501:mount.lustre.0 Request processed in 249us (1847us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460692.723241:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460692.723569:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647808:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788460692.723598:0:19718:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788460692.723939:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460692.723974:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460692.724013:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3053a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.724022:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482647936 00000100:00100000:2.0:1788460692.724029:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482647936 00000100:00100000:2.0:1788460692.724124:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460692.724134:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482647936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460692.724323:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482647936:12345-0@lo:501:mount.lustre.0 Request processed in 191us (348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460692.724331:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788460692.724379:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482647936:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788460692.724462:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460692.724481:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a6e expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.724498:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4400/0x889bb893541b8a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a6e expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460692.724508:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650f5c67000 10000000:01000000:3.0:1788460692.724513:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788460692.724532:0:19718:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788460692.724622:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460692.724629:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460692.724635:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff964fc1289988 10000000:01000000:3.0:1788460692.724639:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788460692.724652:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log nodemap-ffff964fc1289988 from 1 10000000:01000000:3.0:1788460692.724655:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788460692.724678:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.724687:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.724695:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.724719:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460692.724756:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460692.728495:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5e2b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.729891:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648064 00000100:00100000:1.0:1788460692.729905:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648064 00000100:00100000:1.0:1788460692.729967:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788460692.729977:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+13:19718:x1875336482648064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460692.729995:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460692.730017:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b8a7c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a75 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.730045:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b8a7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a75 expref: 14 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.730058:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4a00/0x889bb893541b8a7c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a75 expref: 14 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.732500:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4a00, rc 0) 00000100:00100000:1.0:1788460692.732613:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+14:19718:x1875336482648064:12345-0@lo:101:mount.lustre.0 Request processed in 2634us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.732623:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460692.732844:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460692.732868:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a7c expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.732880:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a7c expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460692.732904:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788460692.732925:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a7c expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.732933:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650efdc5200/0x889bb893541b8a75 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a7c expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460692.732942:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788460692.732948:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460692.732972:0:19718:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460692.733306:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460692.733315:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460692.733326:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650f5c67000 10000000:01000000:0.0:1788460692.733329:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788460692.733363:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788460692.733366:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788460692.733398:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.733407:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.733416:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460692.733437:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460692.733479:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.733513:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.736707:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648192 00000100:00100000:2.0:1788460692.736725:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648192 00000100:00100000:2.0:1788460692.736821:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788460692.736832:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+14:19718:x1875336482648192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460692.736851:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460692.736870:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650ec008400/0x889bb893541b8a8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a83 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.736898:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650ec008400/0x889bb893541b8a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a83 expref: 15 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.736909:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650ec008400/0x889bb893541b8a8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a83 expref: 15 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.736918:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650ec008400, rc 0) 00000100:00100000:2.0:1788460692.737008:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648192:12345-0@lo:101:mount.lustre.0 Request processed in 178us (3528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.737016:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788460692.737622:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460692.737643:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a8a expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.737654:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8a8a expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460692.739972:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000040:00080000:0.0:1788460692.740865:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460692.741095:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1788460692.741141:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 128 off8544 00000040:00080000:0.0:1788460692.741205:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 112 off8656 00000040:00080000:0.0:1788460692.741255:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8880 00000040:00080000:0.0:1788460692.741291:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9104 00000040:00080000:0.0:1788460692.741323:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 80 off9184 00000040:00080000:0.0:1788460692.741369:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 224 off9408 00000040:00080000:0.0:1788460692.741413:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9632 00000040:00080000:0.0:1788460692.741445:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 80 off9712 00000040:00080000:0.0:1788460692.741491:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off9936 00000040:00080000:0.0:1788460692.741530:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10160 00000040:00080000:0.0:1788460692.741580:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 120 off10280 00000040:00080000:0.0:1788460692.741657:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 224 off10504 00000040:00080000:0.0:1788460692.741666:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 13 count 14 00000100:00100000:0.0:1788460692.741762:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460692.741826:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.741869:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.742420:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648320 00000100:00100000:2.0:1788460692.742429:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648320 00000100:00100000:2.0:1788460692.742483:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460692.742494:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648320:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460692.742884:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648320:12345-0@lo:501:mount.lustre.0 Request processed in 392us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.742893:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460692.743680:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460692.743747:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460692.743802:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.743873:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.743908:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648448 00000100:00100000:1.0:1788460692.743914:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648448 00000100:00100000:1.0:1788460692.743987:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460692.743998:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648448:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460692.744579:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648448:12345-0@lo:503:mount.lustre.0 Request processed in 581us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.744587:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460692.744670:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648448:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460692.745612:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460692.745721:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648576:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460692.745791:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.746390:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f5906840 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.746479:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648576 00000100:00100000:2.0:1788460692.746488:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648576 00000100:00100000:0.0:1788460692.746597:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788460692.746608:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460692.747062:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648576:12345-0@lo:502:mount.lustre.0 Request processed in 455us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.747311:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460692.747629:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648576:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460692.747902:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1788460692.747956:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 128 off8544 00000040:00080000:1.0:1788460692.747989:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 112 off8656 00000040:00080000:1.0:1788460692.748036:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8880 00000040:00080000:0.0:1788460692.748563:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9104 00000040:00080000:0.0:1788460692.748611:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 80 off9184 00000040:00080000:0.0:1788460692.748674:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 224 off9408 00000040:00080000:0.0:1788460692.748711:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9632 00000040:00080000:0.0:1788460692.748756:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 80 off9712 00000040:00080000:0.0:1788460692.748823:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off9936 00000040:00080000:0.0:1788460692.748858:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10160 00000040:00080000:0.0:1788460692.748898:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 120 off10280 00000100:00100000:0.0:1788460692.748948:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460692.749017:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.749103:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.749426:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648704 00000100:00100000:3.0:1788460692.749434:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648704 00000100:00100000:3.0:1788460692.749533:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788460692.749543:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648704:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460692.749775:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648704:12345-0@lo:502:mount.lustre.0 Request processed in 233us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.749783:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788460692.749872:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460692.749958:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 224 off10504 00000040:00080000:0.0:1788460692.749970:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788460692.750893:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788460692.750901:0:19732:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788460692.750907:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460692.750909:0:19732:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788460692.750914:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788460692.750928:0:19732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9650f5cf6620) 00000020:00000080:0.0:1788460692.750947:0:19732:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788460692.750952:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788460692.751025:0:19732:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650f5c67000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788460692.751032:0:19732:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460692.751038:0:19732:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x889bb893541b8a98 00010000:00010000:0.0:1788460692.761481:0:19732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1788460692.764151:0:19732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788460692.767539:0:19732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788460692.769900:0:19732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788460692.769912:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460692.769918:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.769920:0:19732:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788460692.769934:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788460692.769937:0:19732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788460692.769939:0:19732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460692.769940:0:19732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460692.769942:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788460692.769945:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.769946:0:19732:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788460692.769948:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460692.769951:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.769952:0:19732:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788460692.769955:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788460692.769957:0:19732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788460692.769959:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460692.769961:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.769962:0:19732:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788460692.769964:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460692.769966:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.769967:0:19732:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788460692.769971:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788460692.770036:0:19732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460692.770040:0:19732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460692.770041:0:19732:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460692.770044:0:19732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 14 count 14 00000020:01000000:1.0:1788460692.776339:0:19718:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788460692.776362:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788460692.776539:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a8a expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.776554:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4a00/0x889bb893541b8a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8a8a expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460692.776562:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f5c67000 from 1 10000000:01000000:1.0:1788460692.776565:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460692.776604:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.776621:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.776631:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460692.776655:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460692.776721:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.776775:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c1515000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460692.777302:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648832 00000100:00100000:0.0:1788460692.777311:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648832 00000100:00100000:0.0:1788460692.777359:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788460692.777369:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+15:19718:x1875336482648832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460692.777383:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460692.777413:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8a9f expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.777449:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8a9f expref: 16 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.777459:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a9f expref: 16 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.777468:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5000, rc 0) 00000100:00100000:0.0:1788460692.777513:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+16:19718:x1875336482648832:12345-0@lo:101:mount.lustre.0 Request processed in 146us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.777520:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788460692.777843:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460692.777869:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.777878:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460692.778563:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648960:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788460692.778683:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.778725:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c1515000 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.781048:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482648960 00000100:00100000:3.0:1788460692.781060:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482648960 00000100:00100000:3.0:1788460692.781148:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788460692.781158:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+16:19718:x1875336482648960:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788460692.781200:0:19028:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460692.781220:0:19028:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460692.781224:0:19028:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788460692.781341:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+16:19718:x1875336482648960:12345-0@lo:256:mount.lustre.0 Request processed in 184us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.781349:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788460692.781791:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482648960:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788460692.782426:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460692.782447:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.782459:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460692.782468:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f5c67000 from 1 10000000:01000000:1.0:1788460692.782471:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460692.782508:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.782517:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.782526:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460692.782545:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460692.782596:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.783083:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460692.783345:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649088 00000100:00100000:0.0:1788460692.783353:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649088 00000100:00100000:0.0:1788460692.783506:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788460692.783518:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+16:19718:x1875336482649088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460692.783532:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460692.783547:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8aad expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.783569:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8aad expref: 17 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.783580:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8aad expref: 17 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.783589:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4000, rc 0) 00000100:00100000:0.0:1788460692.783752:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649088:12345-0@lo:101:mount.lustre.0 Request processed in 236us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.783759:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788460692.783926:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460692.783942:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.783950:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460692.784774:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:1.0:1788460692.785801:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460692.786056:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788460692.786102:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:1.0:1788460692.786149:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:1.0:1788460692.786214:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:1.0:1788460692.786252:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:1.0:1788460692.786302:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:1.0:1788460692.786337:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:1.0:1788460692.786371:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:1.0:1788460692.786844:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:1.0:1788460692.786854:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:1.0:1788460692.786936:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460692.786998:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460692.787080:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d0a98180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460692.787121:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649216 00000100:00100000:0.0:1788460692.787127:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649216 00000100:00100000:1.0:1788460692.787383:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788460692.787407:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460692.787904:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649216:12345-0@lo:501:mount.lustre.0 Request processed in 511us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.787924:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788460692.787992:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460692.788032:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460692.788073:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.788158:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.788605:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649344 00000100:00100000:3.0:1788460692.788620:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649344 00000100:00100000:3.0:1788460692.788652:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460692.788659:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460692.788844:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649344:12345-0@lo:503:mount.lustre.0 Request processed in 185us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.788851:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788460692.789000:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788460692.789592:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460692.789855:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460692.789906:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.789945:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.790081:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649472 00000100:00100000:1.0:1788460692.790087:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649472 00000100:00100000:1.0:1788460692.790119:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460692.790128:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460692.790314:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649472:12345-0@lo:502:mount.lustre.0 Request processed in 188us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.790322:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788460692.790538:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460692.790781:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:0.0:1788460692.790831:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:0.0:1788460692.790884:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:0.0:1788460692.790922:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:0.0:1788460692.790959:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:0.0:1788460692.791026:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:0.0:1788460692.791065:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:0.0:1788460692.791101:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000100:00100000:0.0:1788460692.791130:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460692.791175:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.791249:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e886b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.791412:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649600 00000100:00100000:1.0:1788460692.791418:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649600 00000100:00100000:1.0:1788460692.791447:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460692.791454:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460692.792037:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649600:12345-0@lo:502:mount.lustre.0 Request processed in 581us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.792045:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788460692.792154:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460692.792344:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:0.0:1788460692.792355:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788460692.794308:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460692.794320:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794323:0:19736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788460692.794329:0:19736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650f5c67000 00000020:00000080:1.0:1788460692.794332:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460692.794338:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460692.794340:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794342:0:19736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788460692.794345:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460692.794347:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794348:0:19736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788460692.794352:0:19736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650f5c67000 00000020:00000080:1.0:1788460692.794354:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460692.794414:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460692.794418:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794419:0:19736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788460692.794422:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460692.794424:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794426:0:19736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460692.794430:0:19736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650f5c67000 00000020:00000080:1.0:1788460692.794431:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460692.794470:0:19736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460692.794474:0:19736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460692.794475:0:19736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788460692.794478:0:19736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 10 00000020:01000000:2.0:1788460692.794692:0:19718:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788460692.794706:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460692.794729:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.794753:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460692.794859:0:19718:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788460692.794863:0:19718:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650f5c67000 10000000:01000000:2.0:1788460692.794865:0:19718:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650f5c67000 10000000:01000000:2.0:1788460692.794876:0:19718:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460692.794890:0:19718:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788460692.794940:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460692.794946:0:19718:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460692.794956:0:19718:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650f5c67000 from 1 10000000:01000000:2.0:1788460692.794960:0:19718:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788460692.794994:0:19718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.795002:0:19718:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.795012:0:19718:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460692.795034:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460692.796562:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.796611:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.796640:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649728 00000100:00100000:1.0:1788460692.796649:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649728 00000100:00100000:1.0:1788460692.796700:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788460692.796709:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19718:x1875336482649728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460692.796723:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460692.796751:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5400/0x889bb893541b8ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8abb expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.796776:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5400/0x889bb893541b8ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8abb expref: 18 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.796788:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5400/0x889bb893541b8ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8abb expref: 18 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.796797:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5400, rc 0) 00000100:00100000:1.0:1788460692.796843:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482649728:12345-0@lo:101:mount.lustre.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.796850:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788460692.796886:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460692.796904:0:19718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ac2 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.796914:0:19718:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8ac2 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460692.799766:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 42 count 42 00000040:00080000:2.0:1788460692.801582:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460692.802508:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:2.0:1788460692.802581:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:2.0:1788460692.802630:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:2.0:1788460692.802991:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:2.0:1788460692.803368:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:2.0:1788460692.803432:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:2.0:1788460692.803468:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:2.0:1788460692.803499:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:2.0:1788460692.803567:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:2.0:1788460692.803620:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:2.0:1788460692.804144:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:2.0:1788460692.804227:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:2.0:1788460692.804270:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:2.0:1788460692.804337:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:2.0:1788460692.804424:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:2.0:1788460692.804499:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:2.0:1788460692.804572:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:2.0:1788460692.804892:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:2.0:1788460692.804955:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:2.0:1788460692.805236:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:2.0:1788460692.805556:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:2.0:1788460692.805581:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:2.0:1788460692.805598:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:2.0:1788460692.805621:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:2.0:1788460692.805643:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 128 off12440 00000040:00080000:2.0:1788460692.805791:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12664 00000040:00080000:2.0:1788460692.805850:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12888 00000040:00080000:2.0:1788460692.805897:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off12968 00000040:00080000:2.0:1788460692.805942:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13192 00000040:00080000:2.0:1788460692.806000:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13416 00000040:00080000:2.0:1788460692.806043:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13504 00000040:00080000:2.0:1788460692.806093:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13632 00000040:00080000:2.0:1788460692.806147:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13776 00000040:00080000:2.0:1788460692.806222:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13904 00000040:00080000:2.0:1788460692.806316:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14128 00000040:00080000:2.0:1788460692.806460:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14352 00000040:00080000:2.0:1788460692.806492:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14432 00000040:00080000:2.0:1788460692.806509:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14656 00000040:00080000:2.0:1788460692.806541:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14880 00000040:00080000:2.0:1788460692.806562:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 120 off15000 00000040:00080000:2.0:1788460692.806625:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 224 off15224 00000040:00080000:2.0:1788460692.806629:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 41 count 42 00000100:00100000:2.0:1788460692.806832:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460692.806900:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.806946:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.808585:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649856 00000100:00100000:3.0:1788460692.808599:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649856 00000100:00100000:3.0:1788460692.808712:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460692.808722:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482649856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460692.808986:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482649856:12345-0@lo:501:mount.lustre.0 Request processed in 265us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.809003:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788460692.809251:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460692.809298:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649984:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460692.809342:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.809373:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.809709:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482649984 00000100:00100000:3.0:1788460692.809715:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482649984 00000100:00100000:3.0:1788460692.809753:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460692.809761:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482649984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460692.809915:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482649984:12345-0@lo:503:mount.lustre.0 Request processed in 154us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.809922:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788460692.810276:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482649984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460692.813880:0:19718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460692.813986:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460692.814066:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.814111:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460692.814217:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650112 00000100:00100000:3.0:1788460692.814225:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650112 00000100:00100000:3.0:1788460692.814272:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460692.814281:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460692.814520:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650112:12345-0@lo:502:mount.lustre.0 Request processed in 240us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460692.814530:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460692.815333:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460692.816389:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:2.0:1788460692.817341:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:2.0:1788460692.817381:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:2.0:1788460692.818343:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:2.0:1788460692.818389:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:2.0:1788460692.818998:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:2.0:1788460692.819041:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:2.0:1788460692.819074:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:2.0:1788460692.819134:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:2.0:1788460692.819215:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:2.0:1788460692.819252:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:2.0:1788460692.819303:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:2.0:1788460692.819340:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:2.0:1788460692.819373:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:2.0:1788460692.821991:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:2.0:1788460692.822052:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:2.0:1788460692.822089:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:2.0:1788460692.822605:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:2.0:1788460692.824559:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:2.0:1788460692.824632:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:2.0:1788460692.824704:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:2.0:1788460692.824752:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:2.0:1788460692.824786:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:2.0:1788460692.824833:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:2.0:1788460692.824870:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 128 off12440 00000040:00080000:2.0:1788460692.824907:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12664 00000040:00080000:2.0:1788460692.824951:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12888 00000040:00080000:2.0:1788460692.824985:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off12968 00000040:00080000:2.0:1788460692.825014:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13192 00000040:00080000:2.0:1788460692.825059:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13416 00000040:00080000:2.0:1788460692.825097:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13504 00000040:00080000:2.0:1788460692.825129:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13632 00000040:00080000:2.0:1788460692.825209:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13776 00000040:00080000:2.0:1788460692.825285:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13904 00000040:00080000:2.0:1788460692.825322:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14128 00000040:00080000:2.0:1788460692.825369:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14352 00000040:00080000:2.0:1788460692.827901:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14432 00000040:00080000:2.0:1788460692.827981:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14656 00000040:00080000:2.0:1788460692.828057:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14880 00000040:00080000:2.0:1788460692.828096:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 120 off15000 00000100:00100000:2.0:1788460692.828711:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460692.828812:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.830790:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650feaeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460692.834861:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650240 00000100:00100000:1.0:1788460692.834883:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650240 00000100:00100000:1.0:1788460692.834989:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788460692.835000:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460692.835315:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650240:12345-0@lo:502:mount.lustre.0 Request processed in 316us (6502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460692.835322:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460692.835619:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460692.835743:0:19718:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 224 off15224 00000040:00080000:0.0:1788460692.835758:0:19718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788460692.842944:0:19741:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788460692.842962:0:19741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9650c786e620) 00000020:00000080:2.0:1788460692.842983:0:19741:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788460692.843051:0:19741:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650f5c67000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788460692.843055:0:19741:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650f5c67000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788460692.843058:0:19741:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650f5c67000 3 00010000:00080000:2.0:1788460692.843089:0:19741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9650d1050800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.132@tcp at head 00010000:00010000:2.0:1788460692.848077:0:19741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788460692.848537:0:19741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788460692.848577:0:19741:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460692.848589:0:19741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x889bb893541b8ad0 00000100:00080000:2.0:1788460692.848599:0:19741:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460692.848605:0:19741:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9650d1050800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460692.848652:0:19741:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc44700 x1875336482650368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460692.848682:0:19741:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460692.849013:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460692.849018:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460692.849021:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460692.849024:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788460692.849171:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460692.849214:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482650496:0@lo:400:kworker.0 00000100:00100000:0.0:1788460692.849282:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.849337:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650496 00000100:00100000:0.0:1788460692.849344:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650496 00000100:00100000:0.0:1788460692.849387:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460692.849395:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482650496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460692.849456:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482650496:12345-0@lo:400:kworker.0 Request processed in 62us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.849464:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788460692.849504:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650fd3c7b80 x1875336482650496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460692.849517:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482650496:0@lo:400:kworker.0 00000100:00100000:3.0:1788460692.849665:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482650368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460692.849698:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788460692.850015:0:19741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 42 count 42 00000100:00100000:0.0:1788460692.850342:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650368 00000100:00100000:0.0:1788460692.850348:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650368 00000100:00100000:0.0:1788460692.850378:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460692.850384:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875336482650368:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788460692.850418:0:19035:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1788460692.850554:0:19035:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x889bb893541b8ad7 00000004:00100000:0.0:1788460692.850569:0:19035:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788460692.850600:0:19035:0:(import.c:65:import_set_state_nolock()) ffff9650d0258000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460692.850791:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875336482650368:12345-0@lo:38:llog_process_th.0 Request processed in 405us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460692.850799:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:0.0:1788460692.850830:0:19718:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788460692.850845:0:19718:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788460692.850859:0:19718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ac2 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460692.850870:0:19718:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009000/0x889bb893541b8abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8ac2 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788460692.850917:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788460692.850919:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460692.850920:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460692.850922:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460692.850923:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460692.850924:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460692.850926:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460692.850927:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460692.850928:0:19718:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460692.850932:0:19718:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788460692.850934:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460692.850936:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460692.850937:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460692.850938:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460692.850939:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460692.850940:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460692.850941:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460692.850942:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460692.850943:0:19718:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460692.850960:0:19718:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788460692.850979:0:19718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650624:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788460692.851016:0:19718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460692.851040:0:19718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.851098:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650624 00000100:00100000:2.0:1788460692.851103:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650624 00000100:00100000:2.0:1788460692.851139:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788460692.851147:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650624:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460692.851166:0:19027:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788460692.851206:0:19027:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788460692.851839:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9650efc44700 x1875336482650368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460692.851850:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460692.851857:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788460692.851864:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788460692.851869:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460692.851872:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650d1050800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460692.851877:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3315:1875336482650368:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788460692.876359:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788460692.888340:0:19027:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788460692.888396:0:19027:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788460692.890359:0:19050:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788460692.890369:0:19050:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788460692.890395:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890515:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a28 expref: 18 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890524:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a9f expref: 18 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890531:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890572:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 18 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890586:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 18 pid: 19027 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.890598:0:19050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcffb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482650752:0@lo:104: 00000100:00100000:3.0:1788460692.890672:0:19050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460692.890776:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 18 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.890785:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 18 pid: 19028 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.890794:0:19050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482650880:0@lo:104: 00000100:00100000:3.0:1788460692.890816:0:19050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460692.893955:0:19050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788460692.894035:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650752 00000100:00100000:2.0:1788460692.894054:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650752 00000100:00100000:2.0:1788460692.894092:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482650880 00000100:00100000:2.0:1788460692.894096:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482650880 00000100:00100000:2.0:1788460692.894113:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460692.894121:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+4:19050:x1875336482650752:12345-0@lo:104: 00010000:00010000:2.0:1788460692.894147:0:19018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894288:0:19018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460692.894294:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+4:19050:x1875336482650752:12345-0@lo:104: Request processed in 174us (3623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.894301:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460692.894320:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460692.894326:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+3:19050:x1875336482650880:12345-0@lo:104: 00010000:00010000:2.0:1788460692.894334:0:19018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894369:0:19018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460692.894375:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+3:19050:x1875336482650880:12345-0@lo:104: Request processed in 50us (3558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.894381:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788460692.894489:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460692.894496:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.894503:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5a00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:1.0:1788460692.894507:0:19023:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.894515:0:19023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460692.894521:0:19023:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460692.894526:0:19023:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460692.894563:0:19023:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.894570:0:19023:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460692.894591:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.894598:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff964fc1ea5a00/0x889bb893541b8a28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a2f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460692.894633:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460692.894635:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460692.894637:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460692.894731:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460692.894745:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894751:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5600 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460692.894753:0:19022:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894771:0:19022:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460692.894777:0:19022:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460692.894782:0:19022:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460692.894797:0:19022:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894803:0:19022:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460692.894828:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894835:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5600/0x889bb893541b8a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aa6 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.894851:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460692.894853:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460692.894854:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460692.894863:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460692.894875:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482651008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460692.894913:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.894952:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482651136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460692.894973:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460692.895019:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651008 00000100:00100000:2.0:1788460692.895024:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651008 00010000:00010000:2.0:1788460692.895044:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 19 pid: 19028 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460692.895076:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651136 00000100:00100000:2.0:1788460692.895080:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651136 00010000:00010000:2.0:1788460692.895092:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 20 pid: 19027 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460692.895104:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460692.895110:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+20:3316:x1875336482651008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460692.895121:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460692.895126:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 20 pid: 19028 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895147:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 20 pid: 19028 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895162:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460692.895218:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+20:3316:x1875336482651008:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.895225:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460692.895238:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460692.895244:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+19:3318:x1875336482651136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460692.895251:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460692.895255:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 19 pid: 19027 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895264:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 19 pid: 19027 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895275:0:19021:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895290:0:19021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788460692.895304:0:19021:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004936355s 00010000:00010000:2.0:1788460692.895309:0:19021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895316:0:19021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895323:0:19021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895329:0:19021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895334:0:19021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460692.895338:0:19021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895345:0:19021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895353:0:19021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460692.895362:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460692.895389:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+19:3318:x1875336482651136:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.895396:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460692.895640:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482651008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460692.895666:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482651136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460692.895778:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:19718:x1875336482650624:12345-0@lo:253:mount.lustre.0 Request processed in 44632us (44761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460692.895787:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788460692.896106:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea5000/0x889bb893541b8aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8a9f expref: 17 pid: 19027 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.896118:0:19050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcffb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482650752:0@lo:104: 00010000:00010000:3.0:1788460692.896131:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4600/0x889bb893541b8a2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8a28 expref: 16 pid: 19028 timeout: 666 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460692.896312:0:19050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482650880:0@lo:104: 00010000:00010000:3.0:1788460692.896338:0:19050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.896348:0:19050:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.896354:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460692.896360:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4400/0x889bb893541b8ade lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460692.896535:0:19718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:19718:1875336482650624:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788460692.896546:0:19718:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788460692.896549:0:19718:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788460692.896551:0:19718:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788460692.896552:0:19718:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460692.896553:0:19718:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460692.896554:0:19718:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460692.896556:0:19718:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460692.896557:0:19718:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788460692.896559:0:19718:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460692.896560:0:19718:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788460692.896573:0:19718:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788460692.897078:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460692.897373:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460692.897606:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788460692.897917:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788460692.898065:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788460692.898768:0:19718:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788460692.899754:0:19718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788460692.970532:0:19718:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788460692.970542:0:19718:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788460692.970577:0:19718:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788460692.970653:0:19718:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788460693.909918:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788460694.476322:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460694.476330:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f5c67000 from 10 10000000:01000000:2.0:1788460694.476336:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460694.476380:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.476392:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.476403:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460694.476427:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460694.476487:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460694.476542:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460694.476610:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651264 00000100:00100000:3.0:1788460694.476618:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651264 00000100:00100000:3.0:1788460694.476671:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788460694.476680:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+16:19032:x1875336482651264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460694.476694:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460694.476708:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8ae5 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.476754:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 17 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.476764:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 17 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.476773:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4600, rc 0) 00000100:00100000:3.0:1788460694.476809:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+17:19032:x1875336482651264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460694.476815:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788460694.476942:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460694.476955:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.476964:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460694.477011:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460694.477044:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460694.477067:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460694.477107:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651392 00000100:00100000:3.0:1788460694.477111:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651392 00000100:00100000:3.0:1788460694.477140:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460694.477147:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19032:x1875336482651392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460694.477160:0:19027:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460694.477174:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460694.477204:0:19027:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788460694.477269:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+17:19032:x1875336482651392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460694.477276:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788460694.477347:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460694.477382:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460694.477388:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.477397:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460694.477409:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460694.477411:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc3bbd800 from 10 10000000:01000000:2.0:1788460694.477414:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460694.477429:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.477436:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.477444:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460694.477455:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460694.477479:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460694.477507:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460694.477545:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651520 00000100:00100000:3.0:1788460694.477550:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651520 00000100:00100000:3.0:1788460694.477578:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788460694.477585:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+17:19032:x1875336482651520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460694.477592:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460694.477615:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8af3 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.477639:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8af3 expref: 18 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.477648:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8af3 expref: 18 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460694.477655:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4400, rc 0) 00000100:00100000:3.0:1788460694.477682:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:19032:x1875336482651520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460694.477688:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788460694.477797:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460694.477807:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.477824:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460694.477859:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460694.477886:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460694.477908:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460694.478243:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651648 00000100:00100000:3.0:1788460694.478248:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651648 00000100:00100000:3.0:1788460694.478277:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788460694.478283:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19032:x1875336482651648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460694.478294:0:19029:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460694.478305:0:19029:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460694.478308:0:19029:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788460694.478366:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:19032:x1875336482651648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 83us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460694.478373:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460694.478432:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482651648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460694.478483:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460694.478489:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460694.478498:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460694.931688:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460695.950806:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460696.972559:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460697.997659:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460698.126452:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460698.126458:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460698.126462:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460698.126465:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460698.126509:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482651776:0@lo:400:kworker.0 00000100:00100000:1.0:1788460698.126576:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460698.126650:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482652032:0@lo:400:kworker.0 00000100:00100000:1.0:1788460698.126744:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460698.126765:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460698.126770:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482651904:0@lo:400:kworker.0 00000100:00100000:1.0:1788460698.126792:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460698.126830:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652032 00000100:00100000:1.0:1788460698.126837:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652032 00000100:00100000:1.0:1788460698.126880:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651904 00000100:00100000:1.0:1788460698.126884:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651904 00000100:00100000:1.0:1788460698.126900:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460698.126908:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482652032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460698.126956:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482652032:12345-0@lo:400:kworker.0 Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460698.126962:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460698.126978:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460698.126983:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482651904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460698.127265:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1875336482651904:12345-0@lo:400:kworker.0 Request processed in 271us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460698.127272:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788460698.127310:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108fb80 x1875336482651904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460698.127323:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3317:1875336482651904:0@lo:400:kworker.0 00010000:00080000:1.0:1788460698.127334:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108ea00 x1875336482652032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460698.127341:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482652032:0@lo:400:kworker.0 00000100:00100000:2.0:1788460698.132857:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482651776 00000100:00100000:2.0:1788460698.132873:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482651776 00000100:00100000:2.0:1788460698.132937:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460698.132947:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:3319:x1875336482651776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460698.133050:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+18:3319:x1875336482651776:12345-0@lo:400:kworker.0 Request processed in 104us (6472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460698.133057:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788460698.133102:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460698.133500:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482651776:0@lo:400:kworker.0 00010000:00010000:0.0:1788460699.020270:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460699.195134:0:20085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788460700.048841:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460701.078672:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460701.644977:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788460702.092690:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.116418:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460703.116469:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460688/real 1788460688] req@ffff9650fd3c6680 x1875336482646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460703.116496:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650fd3c6680 x1875336482646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460703 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460703.116508:0:3315:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460688/real 1788460688] req@ffff9650fd3c4380 x1875336482646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460703 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460703.116521:0:3315:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9650fd3c4380 x1875336482646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460703 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788460703.116541:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650ea76b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460703.116567:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460703.116572:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482646784:0@lo:8:kworker.0 00000100:00080000:0.0:1788460703.116578:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460703.116587:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460703.116590:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482646912:0@lo:8:kworker.0 00000100:00080000:1.0:1788460703.116619:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460703.116624:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788460703.116628:0:36:0:(import.c:65:import_set_state_nolock()) ffff9650ea76b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460703.116633:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1788460703.116639:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1788460703.116643:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482652160:0@lo:400:kworker.0 00000100:00080000:1.0:1788460703.116647:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9650ea76b800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460703.116682:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d108ea00 x1875336482652288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460703.116698:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460703.116702:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788460703.116704:0:36:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460703.116707:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1788460703.116710:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788460703.116714:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c511e800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:0.0:1788460703.116722:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460703.116728:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d108fb80 x1875336482652416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460703.116779:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482652544:0@lo:400:kworker.0 00000100:00100000:0.0:1788460703.116795:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482652672:0@lo:400:kworker.0 00000100:00100000:1.0:1788460703.116817:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460703.117278:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652160 00000100:00100000:3.0:1788460703.117286:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652160 00000100:00100000:3.0:1788460703.117349:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460703.117360:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:3318:x1875336482652160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460703.119897:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460703.120016:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652544 00000100:00100000:2.0:1788460703.120026:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652544 00000100:00100000:2.0:1788460703.120091:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652672 00000100:00100000:2.0:1788460703.120094:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652672 00000100:00100000:2.0:1788460703.120118:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460703.120125:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482652544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460703.120193:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482652544:12345-0@lo:400:kworker.0 Request processed in 55us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460703.120200:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460703.121319:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460703.121333:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482652672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460703.121408:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482652672:12345-0@lo:400:kworker.0 Request processed in 81us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460703.121416:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788460703.121448:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460703.121465:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482652288:0@lo:8:kworker.0 00000100:00100000:2.0:1788460703.121503:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460703.121543:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482652416:0@lo:8:kworker.0 00000100:00100000:2.0:1788460703.121566:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460703.121603:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652288 00000100:00100000:2.0:1788460703.121609:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652288 00000100:00100000:2.0:1788460703.121628:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652416 00000100:00100000:2.0:1788460703.121631:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652416 00000100:00100000:2.0:1788460703.121640:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460703.121644:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482652288:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788460703.121679:0:19721:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:2.0:1788460703.121709:0:19721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8b01 00002000:00100000:2.0:1788460703.121723:0:19721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9650d1051000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788460703.121737:0:19721:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788460703.121740:0:19721:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1788460703.122203:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108ce00 x1875336482652672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460703.122219:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482652672:0@lo:400:kworker.0 00002000:00080000:2.0:1788460703.122507:0:19721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788460703.122533:0:19721:0:(import.c:65:import_set_state_nolock()) ffff9650d1052800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460703.122593:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482652288:12345-0@lo:8:kworker.0 Request processed in 946us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460703.122601:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460703.122622:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460703.122627:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482652416:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788460703.122639:0:19721:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788460703.126325:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108ed80 x1875336482652544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460703.126346:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482652544:0@lo:400:kworker.0 00010000:00080000:1.0:1788460703.127357:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108ea00 x1875336482652288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460703.127369:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460703.127451:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788460703.127463:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788460703.127468:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788460703.127472:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650ea76b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788460703.127497:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788460703.127503:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482652288:0@lo:8:kworker.0 00000004:00080000:1.0:1788460703.127564:0:19057:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788460703.127584:0:19057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19057:1875336482652928:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788460703.127643:0:19057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460703.127678:0:19057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8a2cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460703.127690:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460703.127699:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482652800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460703.127724:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460703.127753:0:19722:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788460703.127760:0:19722:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1788460703.128874:0:19056:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788460703.129506:0:19056:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 576365325204ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788460703.132135:0:19719:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788460703.132158:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652928 00000100:00100000:3.0:1788460703.132166:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652928 00000100:00080000:1.0:1788460703.132304:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460703.133233:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460703.133246:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19057:x1875336482652928:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788460703.134432:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:3318:x1875336482652160:12345-0@lo:400:kworker.0 Request processed in 17073us (17708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460703.134444:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460703.134497:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482652160:0@lo:400:kworker.0 00000100:00100000:3.0:1788460703.135321:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482652800 00000100:00100000:3.0:1788460703.135329:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482652800 00000100:00100000:3.0:1788460703.135363:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460703.135371:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482652800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460703.135400:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460703.135457:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482652800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (7731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460703.135463:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788460703.135502:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9650d108ea00 x1875336482652800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460703.135519:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482652800:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788460703.148570:0:20259:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788460703.148582:0:20259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788460703.148587:0:20259:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:65) 00000100:00100000:0.0:1788460703.157393:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482652416:12345-0@lo:8:kworker.0 Request processed in 34758us (35819us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788460703.157412:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788460703.168403:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460703.168416:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788460703.168420:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482652416:0@lo:8:kworker.0 00002000:00010000:1.0:1788460703.175751:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.175765:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.175791:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.175796:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.176516:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.178356:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.178378:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.178387:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.178418:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460703.178596:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460703.178604:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.178614:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460703.178618:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.178627:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.178649:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.178657:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d28258d2/0x889bb893541b8b08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.178702:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.178705:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.178707:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.179034:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.179042:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179054:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.179059:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.179065:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179078:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179112:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179120:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179140:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.179151:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.179156:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179163:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.179168:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179176:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179214:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179222:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8b0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179236:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.179245:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.179247:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.179660:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.179682:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179692:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.179695:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.179700:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179710:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179719:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179726:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179744:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.179753:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.179759:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179766:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.179771:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179791:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179802:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179810:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.179824:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.179826:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.179828:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.180300:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.180307:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180317:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.180321:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.180326:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180337:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180345:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180362:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180375:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460703.180465:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460703.180472:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.180492:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460703.180496:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.180506:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.180521:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.180529:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.180557:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.180560:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.180562:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.180840:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.180846:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180854:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.180857:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.180862:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180871:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180878:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180884:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.180905:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460703.181036:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460703.181044:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.181053:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460703.181057:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.181065:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.181079:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.181097:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd736f1e/0x889bb893541b8b24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.181113:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.181115:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.181117:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.181347:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.181354:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181368:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.181371:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.181376:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181384:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181392:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181400:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181415:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.181424:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.181427:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181435:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.181438:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181447:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181470:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181478:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.181492:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.181494:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.181495:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788460703.187903:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788460703.189478:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.189490:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189507:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.189512:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.189518:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189534:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189545:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189552:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189577:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.189589:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.189595:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189603:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.189608:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189617:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189634:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189642:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8b32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.189672:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.189674:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.189676:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.192946:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.192958:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.193658:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.193683:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.193690:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.193707:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.193718:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.193726:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.194066:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460703.194605:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460703.194615:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.194627:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460703.194632:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.194643:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.194675:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.194695:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8b39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.194718:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.194720:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.194722:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.196677:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.196689:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.196704:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.196709:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.196715:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.196730:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.196745:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.196759:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.196777:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.196791:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.196797:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.197905:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.197911:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.197922:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.197940:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.197948:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8b40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.197970:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.197973:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.198037:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.198836:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.198850:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.198863:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.198867:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.198872:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.198883:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.198892:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.198900:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.198912:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460703.199226:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460703.199234:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.199244:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460703.199248:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.199257:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.199270:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.199278:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8b47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.199292:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.199294:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.199296:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.203053:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.203066:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203084:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.203089:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.203096:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203110:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203120:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203128:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203152:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.203587:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.203597:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.203609:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.203615:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.203626:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.203656:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.203676:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cdf4406/0x889bb893541b8b4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.203701:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.203704:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.203707:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.203742:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.203749:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203759:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.203762:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.203766:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203786:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203794:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203801:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.203821:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460703.204258:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.204265:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204274:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.204278:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.204282:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204291:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204299:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204316:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204340:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460703.204448:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460703.204455:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.204464:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.204468:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.204477:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.204491:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.204499:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b374f23/0x889bb893541b8b55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204508:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.204531:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.204534:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.204537:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.204747:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.204753:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204761:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.204764:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.204768:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204778:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204786:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204794:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.204815:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460703.204844:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460703.204849:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204857:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460703.204860:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204878:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204890:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204898:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8b63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.204911:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.204913:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.204915:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.205232:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.205239:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.205253:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.205257:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.205261:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.205271:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.205279:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.205286:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.205304:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.205340:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.205345:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205353:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.205356:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205365:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205376:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205383:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c3d666b/0x889bb893541b8b6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205400:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205408:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.205411:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205424:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205435:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205442:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8b5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.205455:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.205457:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.205458:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.205463:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.205465:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.205467:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.205506:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.210067:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.210080:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.210097:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.210101:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.210107:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.210121:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.210143:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.210151:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.210175:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.210763:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.210771:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.210780:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.210785:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.210794:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.211010:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.211020:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074db19d7/0x889bb893541b8b71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.211038:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.211040:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.211042:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.211828:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.211838:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.211851:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.211855:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.211861:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.211873:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.211883:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.211890:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.211924:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.212027:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.212033:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.212042:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.212046:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.212054:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.212066:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.212073:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000050dd65b/0x889bb893541b8b78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.212112:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.212113:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.212115:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.212949:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.212957:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.214251:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.214260:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.214268:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.214285:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.214296:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.214303:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.215695:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460703.217656:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460703.217679:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.217692:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460703.217697:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.217708:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.217728:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.217745:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453a16d0/0x889bb893541b8b7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.217765:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.217767:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.217769:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.219849:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.219861:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.219878:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.219889:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.219896:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.219910:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.219920:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.219929:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.219955:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.220007:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.220014:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.220023:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.220028:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.220035:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.220050:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.220058:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec2a884c/0x889bb893541b8b86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.220097:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.220099:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.220101:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.221559:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.221570:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.221585:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.221589:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.221595:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.221608:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.221618:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.221633:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.221670:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.221736:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.221743:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.221762:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.221766:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.221775:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.221791:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.221799:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000948e03a9/0x889bb893541b8b8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.221827:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.221829:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.221831:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.222049:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.222055:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222064:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.222067:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.222072:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222080:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222088:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222095:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222116:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460703.222199:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460703.222206:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.222213:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460703.222217:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.222224:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.222236:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.222243:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4344318/0x889bb893541b8b94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460703.222257:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.222259:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460703.222260:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.222515:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.222521:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222536:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.222539:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.222543:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222553:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222561:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222567:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222587:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.222622:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.222628:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.222635:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.222639:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.222647:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.222674:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.222682:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051de4776/0x889bb893541b8b9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.222709:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.222711:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.222712:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.222970:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.222976:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222983:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.222986:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.222989:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.222997:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223014:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223021:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223041:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.223077:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.223082:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223100:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.223104:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223112:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223123:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223130:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054a7d0a4/0x889bb893541b8ba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223167:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.223168:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.223170:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.223450:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.223456:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223465:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.223469:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.223473:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223482:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223489:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223497:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.223532:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.223649:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.223654:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223674:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.223678:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223686:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223696:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223703:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda8bcbe/0x889bb893541b8ba9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.223718:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.223719:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.223721:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460703.230949:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788460703.230963:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.230984:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=576s v=(0 0) 00010000:00010000:0.0:1788460703.230992:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460703.230999:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.231015:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.231024:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460703.231032:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.231317:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460703.231872:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.231880:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.231898:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.231901:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.231905:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.231915:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.231925:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.231931:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.232116:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788460703.232631:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.232637:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.232647:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.232651:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.232655:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.232675:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.232693:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.232700:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234597:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460703.234612:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234644:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460703.234649:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234660:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234956:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234964:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb7c44e8/0x889bb893541b8bb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234989:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460703.234993:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.234999:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460703.235003:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235016:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235024:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235038:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bc82801/0x889bb893541b8bb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235051:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460703.235054:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235060:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460703.235062:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235069:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235077:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460703.235084:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.235085:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460703.235088:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.239021:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.239022:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788460703.239036:0:20259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb6a434e/0x889bb893541b8bbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.239092:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.240720:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.240731:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.240746:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.240751:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.240757:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.240770:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.240779:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.240796:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.240820:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460703.241360:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.241368:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.241377:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.241382:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.241391:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.241412:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.241419:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5873b8/0x889bb893541b8bc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.241446:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.241449:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.241451:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.244509:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.244549:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.244567:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.244572:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.244579:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.244594:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.244605:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.244613:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.244641:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460703.245224:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.245230:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245240:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.245243:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.245248:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245257:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245272:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245279:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245301:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460703.245311:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460703.245317:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245325:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.245330:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245339:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245357:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245365:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f84195/0x889bb893541b8bcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245385:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.245395:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245401:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.245405:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245413:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245425:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245433:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e59f944/0x889bb893541b8bd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245449:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.245451:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.245453:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460703.245968:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.245975:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.245984:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.245987:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.245991:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246012:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246019:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246025:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246039:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460703.246496:0:20259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788460703.246502:0:20259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246510:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=576s v=(0 0) 00010000:00010000:1.0:1788460703.246513:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460703.246517:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246526:0:20259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246533:0:20259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246551:0:20259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246565:0:20259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460703.246574:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460703.246578:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246584:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.246588:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246595:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246608:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246616:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a550be2a/0x889bb893541b8bda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246634:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460703.246638:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246656:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:1.0:1788460703.246659:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246679:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246691:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246698:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cad21b04/0x889bb893541b8be1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460703.246710:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.246712:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.246714:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460703.246720:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460703.247169:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788460703.258611:0:20259:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788460703.262157:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19057:x1875336482652928:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128909us (134508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460703.262171:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460703.264392:0:19057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19057:1875336482652928:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788460703.264413:0:19057:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788460703.264459:0:19057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19057:1875336482653056:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788460703.264516:0:19057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460703.264560:0:19057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d105df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460703.267822:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653056 00000100:00100000:3.0:1788460703.267836:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653056 00000100:00100000:3.0:1788460703.267891:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460703.267900:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19057:x1875336482653056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788460703.267945:0:19719:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000001:00100000:1.0:1788460703.313985:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788460703.317411:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19057:x1875336482653056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 49504us (52886us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788460703.317426:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460703.318496:0:19057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19057:1875336482653056:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788460703.318512:0:19057:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:3.0:1788460704.140467:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460705.165912:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788460706.020394:0:20437:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:1.0:1788460706.020399:0:20437:0:(obd_mount.c:1014:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788460706.020508:0:20437:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9650fde1e000 00000020:01000004:1.0:1788460706.020524:0:20437:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788460706.020537:0:20437:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788460706.020561:0:20437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff964fc128b310) 00000020:00000080:1.0:1788460706.020579:0:20437:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788460706.044256:0:20437:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788460706.044520:0:20437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788460706.047105:0:20437:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788460706.047632:0:20437:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788460706.047869:0:20437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788460706.050933:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 527: rc = 0 00100000:10000000:3.0:1788460706.051140:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 527: rc = 0 00100000:10000000:3.0:1788460706.051256:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 527: rc = 0 00100000:10000000:3.0:1788460706.052089:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 582: rc = 0 00100000:10000000:3.0:1788460706.052690:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 582: rc = 0 00100000:10000000:3.0:1788460706.053090:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 582: rc = 0 00100000:10000000:3.0:1788460706.053725:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 582: rc = 0 00100000:10000000:3.0:1788460706.053947:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 582: rc = 0 00100000:10000000:3.0:1788460706.054207:0:20437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 582: rc = 0 00000020:00000080:3.0:1788460706.056012:0:20437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788460706.056025:0:20437:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460706.056037:0:20437:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b8bef 00000020:01000004:3.0:1788460706.056044:0:20437:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788460706.056074:0:20437:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.203.132@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460706.056078:0:20437:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.203.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460706.056083:0:20437:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788460706.056116:0:20437:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.132@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788460706.056122:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460706.056123:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460706.056124:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460706.056125:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460706.056126:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460706.056127:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460706.056129:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460706.056130:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460706.056131:0:20437:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460706.056135:0:20437:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788460706.056137:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460706.056138:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460706.056139:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460706.056140:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460706.056141:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460706.056142:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460706.056143:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460706.056144:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460706.056145:0:20437:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460706.056171:0:20437:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788460706.056219:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460706.056284:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460706.056341:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d33339c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.056481:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653184 00000100:00100000:0.0:1788460706.056489:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653184 00000100:00100000:0.0:1788460706.056541:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788460706.056550:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:20437:x1875336482653184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460706.056582:0:19029:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788460706.056585:0:19029:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788460706.056588:0:19029:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788460706.065729:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+18:20437:x1875336482653184:12345-0@lo:253:mount.lustre.0 Request processed in 9173us (9437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.065743:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788460706.065816:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460706.065844:0:20437:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788460706.065847:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460706.065849:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460706.065850:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460706.065851:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460706.065852:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460706.065853:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460706.065854:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460706.065869:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460706.065870:0:20437:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788460706.065888:0:20437:0:(tgt_mount.c:115:server_register_mount()) register mount ffff9650fde1e000 from lustre-OST0001 10000000:01000000:3.0:1788460706.065923:0:20437:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788460706.065926:0:20437:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788460706.065933:0:20437:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9650fde1e000 10000000:01000000:3.0:1788460706.065939:0:20437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460706.065967:0:20437:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788460706.070042:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460706.083663:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460706.083686:0:20437:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff9650fde1e000 from 1 10000000:01000000:2.0:1788460706.083689:0:20437:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788460706.083731:0:20437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.083760:0:20437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.083771:0:20437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460706.083796:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460706.083878:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.083931:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d06f79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.084205:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653312 00000100:00100000:3.0:1788460706.084213:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653312 00000100:00100000:3.0:1788460706.084261:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460706.084269:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+18:20437:x1875336482653312:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460706.084281:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460706.084293:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5800/0x889bb893541b8bfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8bf6 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.084314:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5800/0x889bb893541b8bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8bf6 expref: 19 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.084323:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5800/0x889bb893541b8bfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8bf6 expref: 19 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.084331:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5800, rc 0) 00000100:00100000:3.0:1788460706.084376:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653312:12345-0@lo:101:mount.lustre.0 Request processed in 108us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.084383:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788460706.084535:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460706.084552:0:20437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8bfd expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.084561:0:20437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8bfd expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.084772:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460706.084800:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.084828:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.084942:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653440 00000100:00100000:3.0:1788460706.084946:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653440 00000100:00100000:3.0:1788460706.084978:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788460706.084985:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460706.085164:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653440:12345-0@lo:501:mount.lustre.0 Request processed in 179us (365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460706.085171:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460706.086347:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653440:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788460706.086637:0:20437:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.203.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788460706.086887:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460706.086934:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.087036:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460706.092704:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653568 00000100:00100000:2.0:1788460706.092718:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653568 00000100:00100000:2.0:1788460706.092781:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460706.092790:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460706.093061:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653568:12345-0@lo:501:mount.lustre.0 Request processed in 271us (6125us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460706.093069:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788460706.093663:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653568:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788460706.093792:0:20437:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788460706.093819:0:20437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8bfd expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.093830:0:20437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009e00/0x889bb893541b8bf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8bfd expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460706.093841:0:20437:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff9650fde1e000 10000000:01000000:0.0:1788460706.093847:0:20437:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788460706.093865:0:20437:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788460706.093958:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460706.093966:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460706.093973:0:20437:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788460706.093977:0:20437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460706.093990:0:20437:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:0.0:1788460706.094027:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460706.094031:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460706.094037:0:20437:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff9650fde1e000 10000000:01000000:0.0:1788460706.094040:0:20437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788460706.094065:0:20437:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788460706.094069:0:20437:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788460706.094097:0:20437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.094116:0:20437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.094126:0:20437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.094145:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460706.094230:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.094267:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.094323:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653696 00000100:00100000:3.0:1788460706.094329:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653696 00000100:00100000:3.0:1788460706.094370:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788460706.094378:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fca73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+19:20437:x1875336482653696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460706.094389:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460706.094403:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5c00/0x889bb893541b8c0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c04 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.094424:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5c00/0x889bb893541b8c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c04 expref: 20 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.094434:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5c00/0x889bb893541b8c0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c04 expref: 20 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.094442:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5c00, rc 0) 00000100:00100000:3.0:1788460706.094485:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fca73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482653696:12345-0@lo:101:mount.lustre.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.094492:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788460706.094515:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460706.094538:0:20437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c0b expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.094548:0:20437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c0b expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460706.095154:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000040:00080000:1.0:1788460706.095952:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460706.096161:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1788460706.096231:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1788460706.096263:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1788460706.096304:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1788460706.096340:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1788460706.096371:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:1.0:1788460706.096414:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:1.0:1788460706.096451:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:1.0:1788460706.096510:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:1.0:1788460706.096570:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:1.0:1788460706.096578:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 10 count 11 00000100:00100000:1.0:1788460706.096661:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460706.096715:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.096752:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6fdbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.096948:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653824 00000100:00100000:3.0:1788460706.096956:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653824 00000100:00100000:3.0:1788460706.097005:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788460706.097014:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482653824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460706.097469:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482653824:12345-0@lo:501:mount.lustre.0 Request processed in 456us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.097486:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788460706.097993:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460706.098040:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460706.098091:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.098133:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460706.100236:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482653952 00000100:00100000:1.0:1788460706.100252:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482653952 00000100:00100000:1.0:1788460706.100308:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460706.100318:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482653952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460706.100746:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482653952:12345-0@lo:503:mount.lustre.0 Request processed in 429us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460706.100762:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460706.100834:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482653952:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460706.102596:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460706.102708:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460706.102778:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.102883:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.103439:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654080 00000100:00100000:3.0:1788460706.103448:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654080 00000100:00100000:3.0:1788460706.103539:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788460706.103549:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482654080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460706.103811:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482654080:12345-0@lo:502:mount.lustre.0 Request processed in 262us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.103819:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788460706.104020:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460706.104329:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788460706.104383:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1788460706.104420:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1788460706.104468:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1788460706.104505:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1788460706.104540:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:1.0:1788460706.104586:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:1.0:1788460706.104622:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:1.0:1788460706.104684:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:1.0:1788460706.104721:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460706.104773:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.105520:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d14f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788460706.105569:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654208 00000100:00100000:2.0:1788460706.105577:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654208 00000100:00100000:2.0:1788460706.105614:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788460706.105622:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482654208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460706.105931:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482654208:12345-0@lo:502:mount.lustre.0 Request processed in 309us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460706.105940:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788460706.107545:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460706.107697:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:1.0:1788460706.107712:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788460706.109789:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788460706.109800:0:20439:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788460706.110326:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.110329:0:20439:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788460706.110339:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460706.110354:0:20439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9650f5979988) 00000020:00000080:3.0:1788460706.110376:0:20439:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788460706.110383:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788460706.110466:0:20439:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650fde1e000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788460706.110475:0:20439:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788460706.110482:0:20439:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x889bb893541b8c19 00010000:00010000:3.0:1788460706.118577:0:20439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788460706.119960:0:20439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:2.0:1788460706.128391:0:20439:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788460706.130816:0:20439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788460706.130828:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460706.130835:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.130837:0:20439:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788460706.130840:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460706.130854:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.130856:0:20439:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788460706.130860:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788460706.130867:0:20439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788460706.130870:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460706.130873:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.130875:0:20439:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788460706.130877:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460706.130880:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.130881:0:20439:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788460706.130885:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788460706.130943:0:20439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460706.130947:0:20439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460706.130949:0:20439:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788460706.130952:0:20439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:1.0:1788460706.131108:0:20437:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788460706.131122:0:20437:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788460706.131147:0:20437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c0b expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.131170:0:20437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4600/0x889bb893541b8c04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c0b expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460706.131208:0:20437:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650fde1e000 from 1 10000000:01000000:1.0:1788460706.131211:0:20437:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460706.131247:0:20437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.131255:0:20437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.131266:0:20437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460706.131292:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460706.131354:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.131393:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.131607:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654336 00000100:00100000:0.0:1788460706.131615:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654336 00000100:00100000:0.0:1788460706.131673:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460706.131682:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482654336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460706.131696:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460706.131708:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c20 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.131730:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c20 expref: 21 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.131739:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c20 expref: 21 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.131760:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4c00, rc 0) 00000100:00100000:0.0:1788460706.131799:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+21:20437:x1875336482654336:12345-0@lo:101:mount.lustre.0 Request processed in 118us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.131806:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788460706.132034:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460706.132048:0:20437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.132056:0:20437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460706.132703:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654464:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788460706.132747:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.132778:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.132866:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654464 00000100:00100000:3.0:1788460706.132872:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654464 00000100:00100000:3.0:1788460706.132900:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788460706.132907:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:20437:x1875336482654464:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788460706.132922:0:19028:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460706.132937:0:19028:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460706.132942:0:19028:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788460706.132944:0:19028:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 10 00000100:00100000:3.0:1788460706.133029:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:20437:x1875336482654464:12345-0@lo:256:mount.lustre.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.133036:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788460706.133220:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654464:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788460706.141785:0:20437:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460706.141814:0:20437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.141828:0:20437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460706.141837:0:20437:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650fde1e000 from 1 10000000:01000000:1.0:1788460706.141841:0:20437:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460706.141881:0:20437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.141889:0:20437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.141900:0:20437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460706.141922:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460706.141987:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460706.142083:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6d76a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.142266:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654592 00000100:00100000:3.0:1788460706.142274:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654592 00000100:00100000:3.0:1788460706.142361:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788460706.142370:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:20437:x1875336482654592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460706.142384:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460706.142396:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c2e expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.142446:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.142458:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.142467:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5600, rc 0) 00000100:00100000:3.0:1788460706.142516:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654592:12345-0@lo:101:mount.lustre.0 Request processed in 147us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.142522:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788460706.142684:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654592:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460706.142699:0:20437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.142708:0:20437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460706.144314:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 10 count 10 00000040:00080000:3.0:1788460706.145267:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460706.145538:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788460706.145586:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788460706.145638:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788460706.145829:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788460706.145869:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788460706.145923:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788460706.145973:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788460706.146128:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788460706.146232:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788460706.146250:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 9 count 10 00000100:00100000:3.0:1788460706.146336:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654720:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460706.146403:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460706.146438:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c4f80000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.148151:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654720 00000100:00100000:0.0:1788460706.148163:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654720 00000100:00100000:0.0:1788460706.148244:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460706.148255:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460706.148546:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654720:12345-0@lo:501:mount.lustre.0 Request processed in 293us (2142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.148554:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788460706.148699:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460706.148759:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460706.148802:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.148841:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.149013:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654848 00000100:00100000:3.0:1788460706.149019:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654848 00000100:00100000:3.0:1788460706.149065:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460706.149074:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460706.149507:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654848:12345-0@lo:503:mount.lustre.0 Request processed in 432us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.149517:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788460706.150273:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460706.150856:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460706.150956:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460706.151010:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.151054:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.151075:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482654976 00000100:00100000:0.0:1788460706.151082:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482654976 00000100:00100000:0.0:1788460706.151123:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460706.151132:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460706.151349:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482654976:12345-0@lo:502:mount.lustre.0 Request processed in 217us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.151357:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788460706.151550:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482654976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460706.151795:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:2.0:1788460706.151842:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:2.0:1788460706.151893:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:2.0:1788460706.151929:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:2.0:1788460706.151979:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:2.0:1788460706.152031:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:2.0:1788460706.152068:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:2.0:1788460706.152102:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:2.0:1788460706.152130:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460706.152175:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.152240:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e88decc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.152307:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655104 00000100:00100000:0.0:1788460706.152312:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655104 00000100:00100000:0.0:1788460706.152351:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460706.152360:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482655104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460706.152523:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482655104:12345-0@lo:502:mount.lustre.0 Request processed in 164us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.152531:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788460706.152831:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460706.152921:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:2.0:1788460706.152932:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788460706.153794:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460706.153805:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153808:0:20443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788460706.153816:0:20443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650fde1e000 00000020:00000080:1.0:1788460706.153819:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460706.153825:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460706.153827:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153828:0:20443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788460706.153836:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460706.153839:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153840:0:20443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788460706.153843:0:20443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9650fde1e000 00000020:00000080:1.0:1788460706.153845:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460706.153895:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460706.153898:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153899:0:20443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788460706.153902:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460706.153904:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153905:0:20443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460706.153908:0:20443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9650fde1e000 00000020:00000080:1.0:1788460706.153910:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460706.153944:0:20443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460706.153947:0:20443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460706.153949:0:20443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788460706.153952:0:20443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:2.0:1788460706.154094:0:20437:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788460706.154103:0:20437:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460706.154127:0:20437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.154144:0:20437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460706.156358:0:20437:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788460706.156367:0:20437:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff9650fde1e000 10000000:01000000:2.0:1788460706.156370:0:20437:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff9650fde1e000 10000000:01000000:2.0:1788460706.156375:0:20437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460706.156389:0:20437:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.203.132@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788460706.156621:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460706.156631:0:20437:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.203.132@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460706.156658:0:20437:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff9650fde1e000 from 1 10000000:01000000:2.0:1788460706.156715:0:20437:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788460706.156753:0:20437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.156766:0:20437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.156834:0:20437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460706.156859:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460706.156925:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.156974:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea59b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460706.157042:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655232 00000100:00100000:1.0:1788460706.157049:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655232 00000100:00100000:1.0:1788460706.157267:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788460706.157352:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:20437:x1875336482655232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460706.157365:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460706.157379:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5e00/0x889bb893541b8c43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c3c expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.157592:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5e00/0x889bb893541b8c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c3c expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.157604:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5e00/0x889bb893541b8c43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c3c expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460706.157614:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5e00, rc 0) 00000100:00100000:1.0:1788460706.157784:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655232:12345-0@lo:101:mount.lustre.0 Request processed in 434us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460706.157792:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788460706.157911:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460706.157928:0:20437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c43 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.157949:0:20437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c43 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460706.159574:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 42 count 42 00000040:00080000:2.0:1788460706.160386:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460706.161219:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:2.0:1788460706.161269:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:2.0:1788460706.161303:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:2.0:1788460706.161351:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:2.0:1788460706.161388:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:2.0:1788460706.161448:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:2.0:1788460706.161484:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:2.0:1788460706.161549:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:2.0:1788460706.161599:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:2.0:1788460706.161638:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:2.0:1788460706.161683:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:2.0:1788460706.161727:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:2.0:1788460706.161777:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:2.0:1788460706.161813:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:2.0:1788460706.161858:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:2.0:1788460706.161892:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:2.0:1788460706.161922:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:2.0:1788460706.161965:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:2.0:1788460706.161999:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:2.0:1788460706.162028:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:2.0:1788460706.162084:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:2.0:1788460706.162119:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:2.0:1788460706.162149:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:2.0:1788460706.162236:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:2.0:1788460706.162272:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:2.0:1788460706.162316:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:2.0:1788460706.162363:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:2.0:1788460706.162395:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:2.0:1788460706.162428:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:2.0:1788460706.162474:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:2.0:1788460706.162509:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:2.0:1788460706.162540:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:2.0:1788460706.162572:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:2.0:1788460706.162616:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:2.0:1788460706.163233:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:2.0:1788460706.163298:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:2.0:1788460706.163336:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:2.0:1788460706.163367:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:2.0:1788460706.163470:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:2.0:1788460706.163597:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:2.0:1788460706.163710:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:2.0:1788460706.163718:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 41 count 42 00000100:00100000:2.0:1788460706.163886:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460706.163947:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.163993:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea59b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.164069:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655360 00000100:00100000:0.0:1788460706.164077:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655360 00000100:00100000:0.0:1788460706.164130:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788460706.164141:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460706.164813:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655360:12345-0@lo:501:mount.lustre.0 Request processed in 671us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.164823:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788460706.164974:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460706.165018:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460706.165065:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.165101:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650ea59b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.165913:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655488 00000100:00100000:0.0:1788460706.166023:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655488 00000100:00100000:0.0:1788460706.166072:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788460706.166081:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460706.166456:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655488:12345-0@lo:503:mount.lustre.0 Request processed in 375us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.166464:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788460706.166573:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460706.168652:0:20437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460706.168750:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460706.168826:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.168878:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.168991:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655616 00000100:00100000:0.0:1788460706.168998:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655616 00000100:00100000:0.0:1788460706.169050:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788460706.169061:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460706.169404:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655616:12345-0@lo:502:mount.lustre.0 Request processed in 344us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.169412:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788460706.169620:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460706.169954:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:2.0:1788460706.170007:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:2.0:1788460706.170042:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:2.0:1788460706.170083:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:2.0:1788460706.170121:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:2.0:1788460706.170169:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:2.0:1788460706.172020:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:2.0:1788460706.172069:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:2.0:1788460706.172137:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:2.0:1788460706.172174:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:2.0:1788460706.172235:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:2.0:1788460706.172310:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:2.0:1788460706.172352:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:2.0:1788460706.172385:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:2.0:1788460706.172431:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:2.0:1788460706.172467:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:2.0:1788460706.172500:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:2.0:1788460706.172545:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:2.0:1788460706.172581:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:2.0:1788460706.172614:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:2.0:1788460706.172675:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:2.0:1788460706.175034:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:2.0:1788460706.175080:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:2.0:1788460706.175153:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:2.0:1788460706.175221:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:2.0:1788460706.175261:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:2.0:1788460706.175309:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:2.0:1788460706.175369:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:2.0:1788460706.175403:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:2.0:1788460706.175452:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:2.0:1788460706.175497:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:2.0:1788460706.175528:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:2.0:1788460706.175560:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:2.0:1788460706.175602:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:2.0:1788460706.175637:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:2.0:1788460706.179283:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:2.0:1788460706.179330:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:2.0:1788460706.179360:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:2.0:1788460706.179400:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:2.0:1788460706.179431:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:2.0:1788460706.179477:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460706.179553:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.179607:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460706.179796:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655744 00000100:00100000:3.0:1788460706.179804:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655744 00000100:00100000:3.0:1788460706.179913:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788460706.179922:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460706.180122:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482655744:12345-0@lo:502:mount.lustre.0 Request processed in 200us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.180130:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788460706.182958:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482655744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460706.183099:0:20437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:2.0:1788460706.183114:0:20437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788460706.188551:0:20448:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788460706.188569:0:20448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff964fc128cc98) 00000020:00000080:1.0:1788460706.188593:0:20448:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788460706.188707:0:20448:0:(tgt_mount.c:167:server_get_mount()) get mount ffff9650fde1e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460706.188711:0:20448:0:(tgt_mount.c:201:server_put_mount()) put mount ffff9650fde1e000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460706.188714:0:20448:0:(obd_mount.c:798:lustre_put_lsi()) put ffff9650fde1e000 3 00010000:00080000:1.0:1788460706.188744:0:20448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff964fc2404800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.132@tcp at head 00010000:00010000:0.0:1788460706.189237:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460706.190424:0:20448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788460706.193878:0:20448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788460706.193924:0:20448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460706.193938:0:20448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x889bb893541b8c51 00000100:00080000:2.0:1788460706.193949:0:20448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460706.193955:0:20448:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff964fc2404800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:2.0:1788460706.194009:0:20448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650efc44e00 x1875336482655872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460706.194040:0:20448:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788460706.194226:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482655872:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788460706.194256:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460706.194261:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788460706.194264:0:36:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460706.194270:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1788460706.194275:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788460706.194288:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c511e800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:3.0:1788460706.194300:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.194307:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650fd3c6d80 x1875336482656128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460706.194359:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482656128:0@lo:8:kworker.0 00000100:00100000:3.0:1788460706.194385:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460706.194432:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482655872 00000100:00100000:3.0:1788460706.194438:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482655872 00000100:00100000:0.0:1788460706.194459:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656128 00000100:00100000:0.0:1788460706.194465:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656128 00000100:00100000:3.0:1788460706.194479:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460706.194489:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3315:x1875336482655872:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788460706.194495:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788460706.194503:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482656128:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788460706.194527:0:19034:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000020:00000080:3.0:1788460706.194562:0:19034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x889bb893541b8c58 00000004:00100000:3.0:1788460706.194575:0:19034:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788460706.194616:0:19034:0:(import.c:65:import_set_state_nolock()) ffff964fc35c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460706.194681:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875336482655872:12345-0@lo:38:llog_process_th.0 Request processed in 192us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.194765:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460706.194791:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788460706.194819:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460706.194853:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656384 00000100:00100000:3.0:1788460706.194857:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656384 00000100:00100000:3.0:1788460706.194893:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460706.194900:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482656384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460706.195017:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482656384:12345-0@lo:400:kworker.0 Request processed in 117us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.195024:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788460706.195048:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460706.195064:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482656128:12345-0@lo:8:kworker.0 Request processed in 547us (663us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788460706.195072:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788460706.195077:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c4a80 x1875336482656384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460706.195092:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788460706.195120:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460706.195125:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460706.195129:0:3315:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788460706.195132:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482656128:0@lo:8:kworker.0 00010000:00080000:3.0:1788460706.195143:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efc44e00 x1875336482655872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460706.195158:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460706.195163:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788460706.195170:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788460706.195175:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:0.0:1788460706.195254:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482656256:0@lo:400:kworker.0 00000100:00100000:0.0:1788460706.195284:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.195307:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460706.195313:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482656000:0@lo:400:kworker.0 00000100:00100000:0.0:1788460706.195336:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460706.195781:0:3315:0:(import.c:65:import_set_state_nolock()) ffff964fc2404800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460706.195790:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3315:1875336482655872:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460706.195817:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656256 00000100:00100000:3.0:1788460706.195822:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656256 00000100:00100000:3.0:1788460706.195862:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460706.195870:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482656256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460706.195993:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482656256:12345-0@lo:400:kworker.0 Request processed in 124us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.196000:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788460706.196031:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650fd3c5f80 x1875336482656256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460706.196042:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482656256:0@lo:400:kworker.0 00000040:00080000:3.0:1788460706.197081:0:20448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000100:00100000:0.0:1788460706.197235:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656000 00000100:00100000:0.0:1788460706.197242:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656000 00000020:01000000:2.0:1788460706.197280:0:20437:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 00000100:00100000:0.0:1788460706.197293:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 10000000:01000000:2.0:1788460706.197295:0:20437:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1788460706.197303:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482656000:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788460706.197313:0:20437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c43 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.197342:0:20437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008600/0x889bb893541b8c3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c43 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.197370:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875336482656000:12345-0@lo:400:kworker.0 Request processed in 68us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.197377:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1788460706.197398:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788460706.197400:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460706.197402:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460706.197403:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460706.197405:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460706.197406:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460706.197408:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460706.197409:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460706.197410:0:20437:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460706.197414:0:20437:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788460706.197416:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460706.197417:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460706.197418:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460706.197419:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460706.197420:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460706.197422:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460706.197423:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460706.197424:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460706.197424:0:20437:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460706.197444:0:20437:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788460706.197458:0:20437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482656512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460706.197499:0:20437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.197538:0:20437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75facc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460706.197579:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656512 00000100:00100000:0.0:1788460706.197584:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656512 00000100:00100000:0.0:1788460706.197611:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788460706.197618:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:20437:x1875336482656512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460706.197636:0:19027:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:3.0:1788460706.197664:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 20000000:01000000:0.0:1788460706.197668:0:19027:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788460706.197768:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482656000:0@lo:400:kworker.0 20000000:01000000:2.0:1788460706.254167:0:19027:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788460706.254209:0:19027:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788460706.254407:0:19050:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788460706.254412:0:19050:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788460706.254434:0:19050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254451:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 23 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254474:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8af3 expref: 23 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254480:0:19050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c20 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254487:0:19050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254527:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254541:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 23 pid: 19027 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460706.254554:0:19050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656640:0@lo:104: 00000100:00100000:3.0:1788460706.254625:0:19050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.254690:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656640 00010000:00010000:3.0:1788460706.254698:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 23 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.254699:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656640 00010000:00010000:3.0:1788460706.254710:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 23 pid: 19028 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460706.254719:0:19050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656768:0@lo:104: 00000100:00100000:3.0:1788460706.254740:0:19050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460706.254759:0:19050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 23 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.254767:0:19050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 23 pid: 19029 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460706.254782:0:19050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656896:0@lo:104: 00000100:00100000:3.0:1788460706.254800:0:19050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.254844:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656768 00000100:00100000:2.0:1788460706.254849:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656768 00000100:00100000:2.0:1788460706.254867:0:19018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482656896 00000100:00100000:2.0:1788460706.254870:0:19018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482656896 00000100:00100000:2.0:1788460706.254882:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460706.254891:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+5:19050:x1875336482656640:12345-0@lo:104: 00010000:00010000:2.0:1788460706.254911:0:19018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.254996:0:19017:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788460706.255004:0:19017:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788460706.255209:0:19018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460706.255216:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+5:19050:x1875336482656640:12345-0@lo:104: Request processed in 326us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460706.255225:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460706.255248:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460706.255256:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+4:19050:x1875336482656768:12345-0@lo:104: 00010000:00010000:2.0:1788460706.255264:0:19018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255309:0:19018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460706.255315:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+4:19050:x1875336482656768:12345-0@lo:104: Request processed in 62us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460706.255321:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460706.255334:0:19018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460706.255340:0:19018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+3:19050:x1875336482656896:12345-0@lo:104: 00010000:00010000:2.0:1788460706.255348:0:19018:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255379:0:19018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460706.255384:0:19018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:13026af2-46ad-415c-9f59-ba32734436e0+3:19050:x1875336482656896:12345-0@lo:104: Request processed in 45us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460706.255390:0:19018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788460706.255404:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460706.255412:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460706.255413:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255420:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255424:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460706.255429:0:20262:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255439:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:2.0:1788460706.255445:0:19023:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255446:0:20262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255462:0:19023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460706.255464:0:20262:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460706.255480:0:19023:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460706.255481:0:20262:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460706.255490:0:19023:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460706.255515:0:19023:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255522:0:19023:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460706.255526:0:20262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255534:0:20262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460706.255543:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255552:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009800/0x889bb893541b8af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8afa expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255555:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255565:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460706.255565:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5800/0x889bb893541b8c20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c27 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255572:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255579:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009c00 already unused, calling callback (ffffffffc1d1ce00) 00010000:00010000:0.0:1788460706.255580:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788460706.255581:0:19023:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255584:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460706.255593:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460706.255602:0:19023:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.255616:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482657152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460706.255663:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788460706.255681:0:19023:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.255709:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657152 00000100:00100000:0.0:1788460706.255715:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657152 00010000:00010000:0.0:1788460706.255737:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 24 pid: 19027 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.255773:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460706.255782:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+24:3318:x1875336482657152:12345-0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788460706.255788:0:19023:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460706.255794:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460706.255801:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 24 pid: 19027 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255812:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 24 pid: 19027 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.255842:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460706.255869:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13026af2-46ad-415c-9f59-ba32734436e0+24:3318:x1875336482657152:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.255876:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788460706.255897:0:19023:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255905:0:19023:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788460706.255913:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482657152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460706.255914:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.255924:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8ae5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8aec expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.255930:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788460706.255939:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460706.255939:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482657280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460706.255942:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460706.255946:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460706.255966:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460706.256270:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657280 00000100:00100000:2.0:1788460706.256275:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657280 00010000:00010000:2.0:1788460706.256294:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 24 pid: 19029 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460706.256315:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460706.256321:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+24:3318:x1875336482657280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460706.256328:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460706.256331:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 24 pid: 19029 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.256346:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 24 pid: 19029 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460706.256356:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460706.256386:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+24:3318:x1875336482657280:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460706.256393:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460706.256419:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:13026af2-46ad-415c-9f59-ba32734436e0:3318:1875336482657280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460706.258740:0:19050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e8944f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788460706.258781:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea4c00/0x889bb893541b8c27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8c20 expref: 23 pid: 19027 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460706.258797:0:19050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656640:0@lo:104: 00000100:00100000:3.0:1788460706.258809:0:19050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656768:0@lo:104: 00010000:00010000:3.0:1788460706.258818:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4600/0x889bb893541b8aec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8ae5 expref: 22 pid: 19029 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460706.258826:0:19050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19050:1875336482656896:0@lo:104: 00010000:00010000:3.0:1788460706.259106:0:19050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.259131:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460706.259148:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482657024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460706.259227:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460706.259347:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657024 00000100:00100000:0.0:1788460706.259355:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657024 00010000:00010000:0.0:1788460706.259384:0:19020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 22 pid: 19028 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.259442:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788460706.259451:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e89c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13026af2-46ad-415c-9f59-ba32734436e0+22:3317:x1875336482657024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460706.259463:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460706.259469:0:19020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 22 pid: 19028 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259480:0:19020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 22 pid: 19028 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259497:0:19020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4400/0x889bb893541b8afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8af3 expref: 22 pid: 19028 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259510:0:19020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259527:0:19020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788460706.259542:0:19020:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005130522s 00010000:00010000:0.0:1788460706.259546:0:19020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259553:0:19020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259560:0:19020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259568:0:19020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259580:0:19020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:0.0:1788460706.259584:0:19020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259592:0:19020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259610:0:19020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.259615:0:19050:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460706.259620:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460706.259626:0:19050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460706.259633:0:19050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c5f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460706.259672:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e89c2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13026af2-46ad-415c-9f59-ba32734436e0+21:3317:x1875336482657024:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460706.259681:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460706.259690:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482657024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460706.270116:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+20:20437:x1875336482656512:12345-0@lo:253:mount.lustre.0 Request processed in 72490us (72607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460706.270130:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788460706.271735:0:20437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:13026af2-46ad-415c-9f59-ba32734436e0:20437:1875336482656512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460706.271755:0:20437:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788460706.271759:0:20437:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460706.271761:0:20437:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460706.271762:0:20437:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460706.271763:0:20437:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460706.271765:0:20437:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460706.271766:0:20437:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460706.271767:0:20437:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460706.271769:0:20437:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460706.271771:0:20437:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788460706.271788:0:20437:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788460706.272738:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460706.273151:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788460706.273494:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460706.280266:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788460706.280430:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788460706.280587:0:20437:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788460706.282098:0:20437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788460706.372283:0:20437:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788460706.372293:0:20437:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788460706.372334:0:20437:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788460706.372363:0:20437:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788460707.213353:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788460708.172257:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460708.172262:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650fde1e000 from 11 10000000:01000000:2.0:1788460708.172267:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460708.172324:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.172337:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.172359:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.172382:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.172456:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.172508:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460708.172615:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657408 00000100:00100000:1.0:1788460708.172638:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657408 00000100:00100000:1.0:1788460708.172689:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788460708.172699:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+20:19032:x1875336482657408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460708.172720:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460708.172736:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5000/0x889bb893541b8c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c66 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460708.172764:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5000/0x889bb893541b8c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c66 expref: 21 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460708.172775:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5000/0x889bb893541b8c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c66 expref: 21 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460708.172784:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5000, rc 0) 00000100:00100000:1.0:1788460708.172827:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482657408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460708.172834:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788460708.173359:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460708.173375:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c6d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.173384:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c6d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.173451:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.173488:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.173513:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460708.173613:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657536 00000100:00100000:1.0:1788460708.173635:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657536 00000100:00100000:1.0:1788460708.173671:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788460708.173678:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482657536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788460708.173693:0:19027:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788460708.173709:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788460708.173720:0:19027:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788460708.173798:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482657536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460708.173806:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788460708.174517:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460708.174556:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460708.174564:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c6d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.174574:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009600/0x889bb893541b8c66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c6d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460708.174588:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460708.174590:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff9650f5c67000 from 11 10000000:01000000:2.0:1788460708.174599:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460708.174700:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.174709:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.175638:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.175660:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.176238:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.176287:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460708.176973:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657664 00000100:00100000:3.0:1788460708.176981:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657664 00000100:00100000:3.0:1788460708.177025:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788460708.177033:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482657664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460708.177048:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460708.177066:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c74 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.177090:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c74 expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.177101:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4800/0x889bb893541b8c7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c74 expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.177121:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4800, rc 0) 00000100:00100000:3.0:1788460708.177207:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482657664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460708.177214:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788460708.177914:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460708.177934:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c7b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.177944:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c7b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.178006:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.178047:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.178081:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460708.178129:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657792 00000100:00100000:3.0:1788460708.178134:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657792 00000100:00100000:3.0:1788460708.178168:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460708.178204:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482657792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460708.178220:0:19028:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460708.178236:0:19028:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460708.178239:0:19028:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788460708.178328:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482657792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460708.178336:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788460708.179625:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460708.179680:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460708.179690:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c7b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.179709:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec008e00/0x889bb893541b8c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c7b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460708.179804:0:19032:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460708.179806:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff964fc3bbd800 from 11 10000000:01000000:2.0:1788460708.179809:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460708.179839:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.179848:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.179857:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.179873:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.179921:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.180849:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460708.191562:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482657920 00000100:00100000:3.0:1788460708.191576:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482657920 00000100:00100000:3.0:1788460708.191623:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788460708.191643:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482657920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460708.191660:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460708.191678:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4600/0x889bb893541b8c89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8c82 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.191704:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4600/0x889bb893541b8c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8c82 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.192146:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4600/0x889bb893541b8c89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c82 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460708.192172:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4600, rc 0) 00000100:00100000:3.0:1788460708.192267:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482657920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 626us (12345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460708.192274:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788460708.193677:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482657920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460708.193703:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c89 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.193864:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8c89 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460708.193937:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482658048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460708.193994:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.194151:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d28b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460708.194727:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658048 00000100:00100000:3.0:1788460708.194736:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658048 00000100:00100000:3.0:1788460708.194782:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788460708.194791:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482658048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460708.194936:0:19029:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788460708.194951:0:19029:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788460708.194954:0:19029:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788460708.195111:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482658048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 321us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460708.195200:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788460708.195236:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482658048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460708.195293:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460708.195301:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c89 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460708.195311:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650ec009c00/0x889bb893541b8c82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8c89 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460708.236312:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460708.365371:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460708.365393:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482658176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460708.365464:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460708.365659:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658176 00000100:00100000:2.0:1788460708.365666:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658176 00000100:00100000:2.0:1788460708.365726:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460708.365736:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482658176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460708.365769:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788460708.365814:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1875336482658176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460708.365821:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788460708.366732:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460708.371617:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482658176:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788460708.466969:0:6730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:3.0:1788460709.262462:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460710.284392:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460711.315194:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460711.443042:0:38:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460711.443049:0:38:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788460711.443053:0:38:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460711.443066:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9650c511e800 using connection 192.168.203.132@tcp/0@lo 00000100:00100000:1.0:1788460711.443087:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9650d108ed80 x1875336482658560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460711.443143:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482658304:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.443225:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.443268:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482658944:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.443296:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.443330:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460711.443337:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482658816:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.443359:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.443400:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658304 00000100:00100000:1.0:1788460711.443407:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658304 00000100:00100000:1.0:1788460711.443450:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460711.443459:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3317:x1875336482658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.443506:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3317:x1875336482658304:12345-0@lo:400:kworker.0 Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.443514:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460711.443546:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482658560:0@lo:8:kworker.0 00000100:00100000:1.0:1788460711.443573:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.443601:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482658688:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444538:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.444575:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460711.444583:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482658432:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444618:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460711.444669:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482658304:0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444706:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658944 00000100:00100000:1.0:1788460711.444711:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658944 00000100:00100000:1.0:1788460711.444752:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658816 00000100:00100000:1.0:1788460711.444755:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658816 00000100:00100000:1.0:1788460711.444768:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658688 00000100:00100000:1.0:1788460711.444770:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658688 00000100:00100000:1.0:1788460711.444782:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460711.444790:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482658944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444835:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482658944:12345-0@lo:400:kworker.0 Request processed in 46us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.444855:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460711.444871:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460711.444877:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482658816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444908:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482658816:12345-0@lo:400:kworker.0 Request processed in 31us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.444914:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460711.444925:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460711.444931:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482658688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.444962:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482658688:12345-0@lo:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.444968:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460711.444989:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658560 00000100:00100000:1.0:1788460711.444993:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658560 00000100:00100000:1.0:1788460711.445010:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482658432 00000100:00100000:1.0:1788460711.445013:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482658432 00000100:00100000:1.0:1788460711.445037:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460711.445044:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482658432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460711.445074:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482658432:12345-0@lo:400:kworker.0 Request processed in 32us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.445080:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460711.445092:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460711.445096:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3315:x1875336482658560:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788460711.445120:0:19721:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:1.0:1788460711.445149:0:19721:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x889bb893541b8c90 00002000:00100000:1.0:1788460711.445164:0:19721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff964fc2401800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788460711.445176:0:19721:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788460711.445203:0:19721:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788460711.445554:0:19721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788460711.445577:0:19721:0:(import.c:65:import_set_state_nolock()) ffff964fc2402000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460711.445639:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1875336482658560:12345-0@lo:8:kworker.0 Request processed in 540us (2064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.445645:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788460711.445667:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460711.445671:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788460711.445698:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108ed80 x1875336482658560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460711.445711:0:3315:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788460711.445718:0:3315:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788460711.445724:0:3315:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788460711.445726:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9650c511e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788460711.445740:0:3315:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788460711.445745:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3315:1875336482658560:0@lo:8:kworker.0 00000100:00100000:1.0:1788460711.445774:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788460711.445784:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482658432:0@lo:400:kworker.0 00010000:00080000:1.0:1788460711.445795:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108fb80 x1875336482658688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460711.445804:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482658688:0@lo:400:kworker.0 00000004:00080000:2.0:1788460711.448098:0:19059:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788460711.448127:0:19059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19059:1875336482659200:0@lo:5:osp-pre-1-0.0 00010000:00080000:1.0:1788460711.448877:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108ea00 x1875336482658816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460711.448893:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482658816:0@lo:400:kworker.0 00010000:00080000:1.0:1788460711.448925:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650d108ca80 x1875336482658944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460711.448934:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d108ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482658944:0@lo:400:kworker.0 00000004:00080000:1.0:1788460711.449020:0:19058:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788460711.449453:0:19058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 584685273258ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788460711.449477:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460711.449615:0:19059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460711.449654:0:19059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d169be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460711.450552:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659200 00000100:00100000:2.0:1788460711.450564:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659200 00000100:00100000:2.0:1788460711.450641:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460711.450650:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19059:x1875336482659200:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788460711.451693:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460711.451757:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460711.451841:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460711.451866:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659072 00000100:00100000:1.0:1788460711.451872:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659072 00000100:00100000:1.0:1788460711.451904:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460711.451912:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482659072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460711.451938:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788460711.451977:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482659072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460711.451984:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788460711.452018:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9650efc47800 x1875336482659072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460711.452036:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659072:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788460711.459691:0:19721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788460711.459710:0:19721:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788460711.459716:0:19721:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:2.0:1788460711.485554:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.485567:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.485585:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.485590:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.485596:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.485630:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.485642:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.485650:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.485672:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788460711.486233:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.486240:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486250:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.486253:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.486257:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486273:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486282:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486289:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486304:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788460711.486670:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.486676:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486684:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.486687:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.486691:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486700:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486708:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486725:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.486740:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788460711.487125:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.487131:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487140:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.487143:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.487147:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487157:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487164:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487170:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487204:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788460711.487580:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.487586:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.487601:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.493749:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.493771:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.493793:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.493807:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.493815:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.493832:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788460711.494477:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.494850:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.494864:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.494868:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.494873:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.494885:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.494907:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.494915:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.494924:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1788460711.495248:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788460711.495256:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495265:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.495270:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495279:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495296:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495303:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8c97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495323:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788460711.495333:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495340:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.495344:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495352:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495363:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495369:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8c9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495382:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788460711.495386:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495392:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.495395:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495403:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495424:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495430:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009769a8bf/0x889bb893541b8ca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495444:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460711.495447:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495453:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.495456:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495463:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.495472:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495622:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460711.495629:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495635:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460711.495638:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495646:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495669:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495675:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f18ad3b/0x889bb893541b8cb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495689:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460711.495693:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495698:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460711.495701:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495707:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495715:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495721:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005682bd4d/0x889bb893541b8cba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495730:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.495732:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.495738:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460711.495938:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788460711.495944:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495954:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788460711.495958:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460711.495963:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495972:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495980:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.495987:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496005:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460711.496014:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460711.496017:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496024:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5a00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460711.496027:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496046:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496057:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496065:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c98215cf/0x889bb893541b8cc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496078:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.496079:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.496081:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460711.496597:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788460711.496615:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496626:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788460711.496630:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460711.496634:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496644:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496652:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496666:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496682:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460711.496692:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460711.496697:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496703:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5e00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460711.496706:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496714:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496726:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496733:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028c12852/0x889bb893541b8cc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.496746:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.496748:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.496749:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460711.497174:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788460711.497212:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497222:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788460711.497225:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460711.497230:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497238:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497247:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497254:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497269:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460711.497279:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460711.497282:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497289:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460711.497293:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497301:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497320:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497327:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b8ccf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.497341:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.497342:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.497344:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.500667:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a14287f/0x889bb893541b8cac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.500720:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.500722:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.500733:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.500741:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460711.501446:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788460711.501455:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.501470:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1788460711.501476:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460711.501787:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.501804:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.501814:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460711.501821:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502232:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788460711.502744:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.502752:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502764:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.502768:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.502773:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502784:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502792:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502799:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502814:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460711.502826:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460711.502831:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502839:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.502843:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502859:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502875:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502882:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b6154f6/0x889bb893541b8cd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502900:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.502903:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502909:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0030800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.502911:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502918:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502928:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502934:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea4e5bfe/0x889bb893541b8cdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.502960:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.502962:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.502963:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.503382:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.503388:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503398:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.503401:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.503406:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503418:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503426:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503432:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503447:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.503455:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.503460:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503476:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c0031400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.503480:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503487:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503498:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503506:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d490dc6e/0x889bb893541b8ce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503521:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.503522:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.503524:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.503952:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.503957:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503966:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.503969:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.503973:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503982:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.503995:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504002:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504017:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.504025:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.504029:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504035:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.504038:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504045:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504055:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504062:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8ceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504075:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.504082:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.504084:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.504482:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.504488:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504497:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.504500:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.504504:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504514:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504522:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504530:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504544:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.504552:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.504556:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504563:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.504566:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504585:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504596:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504602:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8cf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.504629:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.504631:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.504633:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.505011:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.505017:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505026:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.505029:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.505033:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505042:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505050:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505061:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505074:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.505083:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.505087:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505094:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.505097:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505105:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505117:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505124:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8cf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505138:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.505139:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.505140:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.505539:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.505552:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505560:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.505563:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.505568:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505577:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505586:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.505594:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.508884:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.508928:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.508937:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.508950:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ea00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.508956:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.508967:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.509003:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.509010:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.509033:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.509034:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.509036:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460711.510858:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.512918:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.512932:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.512951:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.512957:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.512962:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.512976:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.512986:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.512994:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513025:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.513038:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.513043:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513051:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166e000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.513056:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513065:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513082:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513089:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002092328d/0x889bb893541b8d07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.513106:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.513108:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.513109:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.515750:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.515763:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515780:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.515789:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.515795:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515809:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515819:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515827:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515842:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.515853:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.515858:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515866:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.515870:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515878:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515893:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515912:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ce0961b/0x889bb893541b8d0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.515931:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.515933:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.515935:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.516382:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.516389:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516399:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.516402:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.516406:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516416:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516423:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516430:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516450:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788460711.516845:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.516855:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516864:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.516867:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.516871:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516880:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516888:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516896:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516910:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460711.516923:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460711.516928:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516935:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f400 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.516939:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516947:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516967:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516974:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ad2e3cf/0x889bb893541b8d15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.516991:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.516994:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517001:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.517004:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517012:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517022:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517029:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d95c19f0/0x889bb893541b8d1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517039:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.517041:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.517048:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.517476:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.517482:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517491:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.517494:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.517498:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517507:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517515:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517521:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517535:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.517544:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.517548:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517554:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166fa00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.517558:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517576:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517587:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.517595:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b860ce8/0x889bb893541b8d23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.520878:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.520886:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.520889:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.521670:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.521681:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521697:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.521701:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.521707:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521721:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521731:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521745:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521766:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.521779:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.521785:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521793:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ec00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.521797:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521807:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521824:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521832:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000984894fd/0x889bb893541b8d2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.521850:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.521852:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.521853:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.522279:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.522294:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522304:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.522307:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.522311:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522321:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522331:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522339:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522352:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.522361:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.522365:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522371:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f200 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.522374:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522382:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522398:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522406:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa0f1f43/0x889bb893541b8d31 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.522422:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.522423:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.522425:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.525396:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.525408:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.525425:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.525430:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.525436:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.525452:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.525463:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.525470:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460711.526504:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.528061:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.528077:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.528084:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.528092:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ee00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.528097:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.528107:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.528125:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.528133:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebf3b11/0x889bb893541b8d38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.528159:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.528161:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.528163:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.530980:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.530993:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531008:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.531020:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.531026:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531040:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531050:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531058:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531077:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.531091:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.531096:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531104:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166f000 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.531108:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531117:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531132:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531152:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dad7adf8/0x889bb893541b8d3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.531174:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.531208:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.531210:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.531980:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.531989:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532001:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.532005:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.532010:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532022:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532031:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532039:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532057:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788460711.532797:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.532810:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532821:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.532825:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.532841:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532854:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532862:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532870:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.532887:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460711.532902:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460711.532908:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533015:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166ea00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.533021:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533030:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533055:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533062:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001569bc3d/0x889bb893541b8d46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533081:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.533085:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533091:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166e600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.533095:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533102:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533113:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533120:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007027e822/0x889bb893541b8d4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533133:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.533135:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.533144:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.533802:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.533809:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533820:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.533824:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.533828:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533932:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533940:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533947:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533964:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.533975:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.533980:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.533987:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c166fe00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.533991:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.534012:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.534024:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.534031:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043240a7f/0x889bb893541b8d54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.534050:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.534053:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.534054:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460711.534851:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.535060:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.535068:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535081:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.535085:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.535090:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535102:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535111:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535125:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535143:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.535152:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.535157:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535164:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec008c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.535169:0:19022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535214:0:19022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535230:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535237:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecaa51f7/0x889bb893541b8d5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.535257:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.535259:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.535261:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.536084:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.536101:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536114:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.536118:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.536122:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536134:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536143:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536150:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536170:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460711.536210:0:19023:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460711.536215:0:19023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536222:0:19023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650ec009800 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460711.536225:0:19023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536233:0:19023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536252:0:19023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536259:0:19023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c2f001f/0x889bb893541b8d62 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.536276:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.536278:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460711.536280:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460711.537334:0:19721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788460711.537343:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.537356:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1788460711.537359:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460711.537364:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.537375:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.537384:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.537391:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460711.537422:0:19721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460711.538171:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460711.538195:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460711.538208:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54400 already unused, calling callback (ffffffffc16fc700) 00002000:00080000:2.0:1788460711.538210:0:19721:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00010000:00010000:1.0:1788460711.538221:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460711.538232:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460711.538252:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460711.538260:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b9c8b5f/0x889bb893541b8d69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460711.538282:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460711.538284:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460711.538286:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460711.538313:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19059:x1875336482659200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 87659us (88704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460711.538323:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460711.539044:0:19059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efc45500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19059:1875336482659200:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788460711.539061:0:19059:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:0.0:1788460711.539111:0:19059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19059:1875336482659328:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788460711.539151:0:19059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460711.539215:0:19059:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c3433d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460711.540128:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659328 00000100:00100000:3.0:1788460711.540138:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659328 00000100:00100000:3.0:1788460711.540215:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460711.540226:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:19059:x1875336482659328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788460711.540269:0:19719:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788460711.557525:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:19059:x1875336482659328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17294us (18365us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788460711.557537:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460711.557900:0:19059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19059:1875336482659328:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788460711.558768:0:19059:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000004:00080000:3.0:1788460711.573416:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000040:00080000:2.0:1788460711.890463:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788460712.007775:0:20793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg332-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788460712.332367:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460713.357776:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460713.484430:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460713.484491:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460713.485993:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659456 00000100:00100000:2.0:1788460713.486003:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659456 00000100:00100000:2.0:1788460713.486072:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460713.486083:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482659456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460713.486118:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788460713.486210:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460713.486217:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482659456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.486226:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460713.486287:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460713.683515:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.683652:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733056 00000100:00100000:2.0:1788460713.683662:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733056 00000100:00100000:2.0:1788460713.683714:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1788460713.683733:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2378:x1875336462733056:12345-192.168.203.32@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788460713.683761:0:19029:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 33947916-367f-49ef-b7e1-278b016d1427@192.168.203.32@tcp t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:2.0:1788460713.683787:0:19029:0:(genops.c:1385:class_connect()) connect: client 33947916-367f-49ef-b7e1-278b016d1427, cookie 0x889bb893541b8d70 00000100:00080000:2.0:1788460713.683931:0:19029:0:(import.c:65:import_set_state_nolock()) ffff964fc233b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460713.684023:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+5:2378:x1875336462733056:12345-192.168.203.32@tcp:250:mount.lustre.0 Request processed in 299us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.684031:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 88 00000100:00100000:2.0:1788460713.690314:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460713.691156:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733184 00000100:00100000:0.0:1788460713.691168:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733184 00000100:00100000:1.0:1788460713.691615:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:1.0:1788460713.691627:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+5:16787:x1875336462733184:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460713.691645:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460713.691662:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb5600/0x889bb893541b8d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17e2 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.691690:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb5600/0x889bb893541b8d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17e2 expref: 6 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.691703:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb5600/0x889bb893541b8d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17e2 expref: 6 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.691712:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5600, rc 0) 00000100:00100000:1.0:1788460713.691785:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+6:16787:x1875336462733184:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 159us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.691792:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 89 00000100:00100000:0.0:1788460713.694417:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.694649:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733312 00000100:00100000:1.0:1788460713.694659:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733312 00000100:00100000:1.0:1788460713.694710:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:1.0:1788460713.694719:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+6:16787:x1875336462733312:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788460713.694972:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+6:16787:x1875336462733312:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 252us (570us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460713.694981:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 90 00000100:00100000:3.0:1788460713.698561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.698804:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733440 00000100:00100000:1.0:1788460713.698814:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733440 00000100:00100000:1.0:1788460713.698869:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:1.0:1788460713.698881:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+6:16787:x1875336462733440:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460713.698896:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460713.698914:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4c00/0x889bb893541b8d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d17e9 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.698941:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4c00/0x889bb893541b8d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17e9 expref: 7 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.698952:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4c00/0x889bb893541b8d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d17e9 expref: 7 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.698961:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4c00, rc 0) 00000100:00100000:1.0:1788460713.699017:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+7:16787:x1875336462733440:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 139us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.699095:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 91 00000100:00100000:3.0:1788460713.713144:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.713234:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733568 00000100:00100000:2.0:1788460713.713244:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733568 00000100:00100000:2.0:1788460713.713295:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:2.0:1788460713.713303:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+7:16787:x1875336462733568:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460713.714019:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+8:16787:x1875336462733568:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 713us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.714029:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 92 00000100:00100000:0.0:1788460713.717692:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460713.717961:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733696 00000100:00100000:3.0:1788460713.717971:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733696 00000100:00100000:3.0:1788460713.718137:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1788460713.718150:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+8:16787:x1875336462733696:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788460713.719898:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+8:16787:x1875336462733696:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 1741us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460713.719923:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 93 00000100:00100000:3.0:1788460713.724570:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.724780:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733824 00000100:00100000:1.0:1788460713.724789:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733824 00000100:00100000:1.0:1788460713.724838:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:1.0:1788460713.724850:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+8:16805:x1875336462733824:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460713.725486:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+8:16805:x1875336462733824:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 636us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.725495:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 94 00000100:00100000:2.0:1788460713.761008:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460713.761160:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462733952 00000100:00100000:3.0:1788460713.761169:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462733952 00000100:00100000:3.0:1788460713.761248:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:3.0:1788460713.761257:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+8:16805:x1875336462733952:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460713.761496:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1997c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+8:16805:x1875336462733952:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 240us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460713.761504:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 95 00000100:00100000:3.0:1788460713.771312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.771629:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734080 00000100:00100000:1.0:1788460713.771640:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734080 00000100:00100000:1.0:1788460713.771698:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:1.0:1788460713.771710:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+8:16787:x1875336462734080:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460713.771728:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460713.771745:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4000/0x889bb893541b8d85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1813 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.771772:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4000/0x889bb893541b8d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1813 expref: 9 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.771784:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4000/0x889bb893541b8d85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1813 expref: 9 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.771793:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4000, rc 0) 00000100:00100000:1.0:1788460713.771852:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+9:16787:x1875336462734080:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 145us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.772055:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 96 00000100:00100000:0.0:1788460713.780378:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.780741:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734208 00000100:00100000:1.0:1788460713.780752:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734208 00000100:00100000:1.0:1788460713.780811:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:1.0:1788460713.780821:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+9:16787:x1875336462734208:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788460713.780845:0:19027:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788460713.781026:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788460713.781031:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788460713.781034:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788460713.781037:0:19027:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:1.0:1788460713.797619:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+9:16787:x1875336462734208:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 16790us (17240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.797634:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 97 00000100:00100000:3.0:1788460713.803841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.804045:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734336 00000100:00100000:1.0:1788460713.804055:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734336 00000100:00100000:1.0:1788460713.804105:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:1.0:1788460713.804116:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+9:16787:x1875336462734336:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460713.804133:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460713.804150:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d181a expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.804199:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 10 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.804210:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 10 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460713.804219:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb4600, rc 0) 00000100:00100000:1.0:1788460713.804278:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1996450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+10:16787:x1875336462734336:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 164us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.804296:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 98 00000100:00100000:0.0:1788460713.806529:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.806725:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734464 00000100:00100000:1.0:1788460713.806735:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734464 00000100:00100000:1.0:1788460713.806788:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:1.0:1788460713.806798:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+10:16787:x1875336462734464:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788460713.808012:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1994c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+10:16787:x1875336462734464:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 1208us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.808034:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 99 00000100:00100000:2.0:1788460713.814337:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460713.814711:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734592 00000100:00100000:3.0:1788460713.814721:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734592 00000100:00100000:3.0:1788460713.814774:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1788460713.814784:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+10:16787:x1875336462734592:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788460713.815012:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc1995050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+10:16787:x1875336462734592:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 228us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460713.815021:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 100 00000100:00100000:3.0:1788460713.817008:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.817145:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734720 00000100:00100000:1.0:1788460713.817154:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734720 00000100:00100000:1.0:1788460713.817230:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:1.0:1788460713.817239:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+10:16809:x1875336462734720:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460713.817491:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+10:16809:x1875336462734720:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 252us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.817500:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 101 00000100:00100000:0.0:1788460713.830320:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.832235:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734848 00000100:00100000:2.0:1788460713.832251:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734848 00000100:00100000:2.0:1788460713.832318:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1788460713.832329:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+10:16809:x1875336462734848:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460713.832872:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+10:16809:x1875336462734848:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 543us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.832881:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 102 00000100:00100000:2.0:1788460713.846015:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.846285:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462734976 00000100:00100000:1.0:1788460713.846296:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462734976 00000100:00100000:1.0:1788460713.846351:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460713.846359:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2378:x1875336462734976:12345-192.168.203.32@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788460713.846387:0:19036:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from 070896ab-fc36-4f97-80f6-7a8728f1dddc@192.168.203.32@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1788460713.846431:0:19036:0:(genops.c:1385:class_connect()) connect: client 070896ab-fc36-4f97-80f6-7a8728f1dddc, cookie 0x889bb893541b8d93 00000004:00100000:1.0:1788460713.846458:0:19036:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788460713.846463:0:19036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788460713.902036:0:19036:0:(import.c:65:import_set_state_nolock()) ffff964fc2471000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460713.902132:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2378:x1875336462734976:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 55771us (56123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460713.902144:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:3.0:1788460713.909646:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460713.909688:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.909784:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735232 00000100:00100000:1.0:1788460713.909807:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735232 00000100:00100000:1.0:1788460713.909869:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735104 00000100:00100000:1.0:1788460713.909872:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735104 00000100:00100000:1.0:1788460713.909886:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460713.909894:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:16787:x1875336462735232:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788460713.909936:0:19035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788460713.910016:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:16787:x1875336462735232:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 122us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.910023:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460713.910038:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460713.910043:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:0:x1875336462735104:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788460713.910052:0:19035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788460713.910069:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:0:x1875336462735104:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.910075:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00080000:3.0:1788460713.910352:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460713.916795:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460713.917233:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735360 00000100:00100000:1.0:1788460713.917244:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735360 00000100:00100000:1.0:1788460713.917311:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460713.917321:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16787:x1875336462735360:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788460713.917406:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16787:x1875336462735360:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 87us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460713.917413:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460713.921602:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.921638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.922079:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460713.922113:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735488 00000100:00100000:2.0:1788460713.922136:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735488 00000100:00100000:2.0:1788460713.922168:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735616 00000100:00100000:2.0:1788460713.922171:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735616 00000100:00100000:2.0:1788460713.922222:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460713.922231:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2378:x1875336462735488:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788460713.922263:0:19721:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from 070896ab-fc36-4f97-80f6-7a8728f1dddc@192.168.203.32@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1788460713.922293:0:19721:0:(genops.c:1385:class_connect()) connect: client 070896ab-fc36-4f97-80f6-7a8728f1dddc, cookie 0x889bb893541b8d9a 00002000:00100000:2.0:1788460713.922304:0:19721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 070896ab-fc36-4f97-80f6-7a8728f1dddc/ffff964fc233d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460713.922314:0:19721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460713.922669:0:19721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788460713.922699:0:19721:0:(import.c:65:import_set_state_nolock()) ffff964fc233f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460713.922762:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2378:x1875336462735488:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 530us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.922781:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460713.922800:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460713.922805:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2378:x1875336462735616:12345-192.168.203.32@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788460713.923575:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735744 00000100:00100000:3.0:1788460713.923583:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735744 00000100:00100000:3.0:1788460713.923638:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460713.923646:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16787:x1875336462735744:12345-192.168.203.32@tcp:33:mount.lustre.0 00010000:00080000:2.0:1788460713.926238:0:19721:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from 070896ab-fc36-4f97-80f6-7a8728f1dddc@192.168.203.32@tcp t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1788460713.926273:0:19721:0:(genops.c:1385:class_connect()) connect: client 070896ab-fc36-4f97-80f6-7a8728f1dddc, cookie 0x889bb893541b8da1 00002000:00100000:2.0:1788460713.926284:0:19721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 070896ab-fc36-4f97-80f6-7a8728f1dddc/ffff964fc2339800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460713.926307:0:19721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460713.926488:0:19721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788460713.926520:0:19721:0:(import.c:65:import_set_state_nolock()) ffff964fc233b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460713.926582:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2378:x1875336462735616:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 3774us (4503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460713.926601:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000004:00080000:3.0:1788460713.934740:0:19037:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11026us 00000004:00200000:0.0:1788460713.959538:0:19037:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788460713.959699:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16787:x1875336462735744:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 36048us (38112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460713.959713:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460714.199678:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460714.199844:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462735872 00000100:00100000:0.0:1788460714.199853:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462735872 00000100:00100000:0.0:1788460714.199920:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:0.0:1788460714.199930:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16830:x1875336462735872:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:0.0:1788460714.199949:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460714.199973:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b8da8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1844 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200042:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200057:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200071:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460714.200122:0:19034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788460714.200125:0:19034:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788460714.200157:0:19034:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200215:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b8da8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1844 expref: 8 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200232:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1844 expref: 7 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460714.200241:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:0.0:1788460714.200244:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460714.200248:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4c00, rc 0) 00000100:00100000:0.0:1788460714.200311:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:16830:x1875336462735872:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 382us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460714.200318:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00010000:00010000:1.0:1788460714.380795:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460715.404909:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460716.420155:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460716.420294:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736000 00000100:00100000:0.0:1788460716.420304:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736000 00000100:00100000:0.0:1788460716.420382:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00080000:3.0:1788460716.420389:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460716.420396:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:16882:x1875336462736000:12345-192.168.203.32@tcp:41:lfs.0 00000004:00000024:0.0:1788460716.420450:0:19036:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788460716.420548:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:16882:x1875336462736000:12345-192.168.203.32@tcp:41:lfs.0 Request processed in 157us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.420556:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00010000:00010000:2.0:1788460716.428378:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460716.431299:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.431441:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736128 00000100:00100000:1.0:1788460716.431451:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736128 00000100:00100000:1.0:1788460716.431540:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460716.431557:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16882:x1875336462736128:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:1.0:1788460716.431611:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788460716.431662:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460716.431700:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16882:x1875336462736128:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 144us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.431708:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:2.0:1788460716.437686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.442486:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736256 00000100:00100000:1.0:1788460716.442503:0:19724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736256 00000100:00100000:1.0:1788460716.442884:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460716.443056:0:19724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16882:x1875336462736256:12345-192.168.203.32@tcp:13:lfs.0 00002000:00000024:1.0:1788460716.443099:0:19724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788460716.443240:0:19724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:16882:x1875336462736256:12345-192.168.203.32@tcp:13:lfs.0 Request processed in 346us (5562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.443247:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:3.0:1788460716.443385:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460716.562730:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482659584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460716.562810:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460716.562882:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482660096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.562928:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460716.562970:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788460716.562979:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482659712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.563136:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460716.563163:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482660224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.563212:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460716.564343:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482659840:0@lo:400:kworker.0 00000100:00100000:2.0:1788460716.564401:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460716.564431:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482660352:0@lo:400:kworker.0 00000100:00100000:2.0:1788460716.564457:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460716.571611:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659712 00000100:00100000:3.0:1788460716.571627:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659712 00000100:00100000:3.0:1788460716.571685:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460716.571696:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482659712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460716.575883:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482659712:12345-0@lo:400:kworker.0 Request processed in 4166us (12723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.575912:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460716.576412:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482659712:0@lo:400:kworker.0 00000100:00100000:3.0:1788460716.576476:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659968:0@lo:400:kworker.0 00000100:00100000:3.0:1788460716.576515:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460716.576651:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660096 00000100:00100000:1.0:1788460716.576658:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660096 00000100:00100000:0.0:1788460716.576775:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660224 00000100:00100000:0.0:1788460716.576787:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660224 00000100:00100000:0.0:1788460716.576834:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660352 00000100:00100000:0.0:1788460716.576837:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660352 00000100:00100000:0.0:1788460716.576861:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460716.576870:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482660224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460716.576924:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482660224:12345-0@lo:400:kworker.0 Request processed in 55us (13710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.576931:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460716.576944:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460716.576950:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482660352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460716.576980:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875336482660352:12345-0@lo:400:kworker.0 Request processed in 30us (12521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.576986:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460716.577023:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460716.577029:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482660096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460716.577058:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1875336482660096:12345-0@lo:400:kworker.0 Request processed in 29us (14130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.577063:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788460716.577093:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460716.577104:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659840 00000100:00100000:0.0:1788460716.577107:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659840 00000100:00100000:0.0:1788460716.577136:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659968 00000100:00100000:0.0:1788460716.577139:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659968 00000100:00100000:0.0:1788460716.577159:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460716.577165:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482659840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.577213:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460716.577223:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482659968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.577265:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3319:x1875336482659968:12345-0@lo:400:kworker.0 Request processed in 44us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.577272:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460716.577300:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482659840:12345-0@lo:400:kworker.0 Request processed in 133us (12897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.577315:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482659584 00000100:00100000:0.0:1788460716.577316:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460716.577320:0:19724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482659584 00000100:00080000:0.0:1788460716.577338:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460716.577341:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460716.577354:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460716.577363:0:19724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482659584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460716.577377:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3318:1875336482660352:0@lo:400:kworker.0 00002000:00000024:1.0:1788460716.577378:0:19724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788460716.577410:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482659840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460716.577417:0:19724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1875336482659584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (14607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.577423:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460716.577664:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482659968:0@lo:400:kworker.0 00000100:00100000:3.0:1788460716.580320:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482660224:0@lo:400:kworker.0 00000100:00100000:3.0:1788460716.580377:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482659584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460716.580393:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3316:1875336482660096:0@lo:400:kworker.0 00000001:00100000:0.0:1788460716.616296:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788460716.616311:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 070896ab-fc36-4f97-80f6-7a8728f1dddc 00000001:00080000:0.0:1788460716.616360:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000100:00100000:2.0:1788460716.677992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.678069:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736384 00000100:00100000:3.0:1788460716.678079:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736384 00000100:00100000:3.0:1788460716.678130:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:3.0:1788460716.678139:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+10:16915:x1875336462736384:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460716.678168:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460716.678220:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5e00/0x889bb893541b8db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d184b expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.678248:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5e00/0x889bb893541b8db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d184b expref: 11 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.678260:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5e00/0x889bb893541b8db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d184b expref: 11 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.678270:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5e00, rc 0) 00000100:00100000:3.0:1788460716.678323:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+11:16915:x1875336462736384:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.678331:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 104 00000100:00100000:0.0:1788460716.681536:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.681657:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736512 00000100:00100000:3.0:1788460716.681667:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736512 00000100:00100000:3.0:1788460716.681775:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:3.0:1788460716.681785:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+11:16915:x1875336462736512:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788460716.682064:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+11:16915:x1875336462736512:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 279us (535us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460716.682072:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 105 00000100:00100000:0.0:1788460716.684710:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.685451:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736640 00000100:00100000:2.0:1788460716.685463:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736640 00000100:00100000:2.0:1788460716.685522:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1788460716.685532:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+11:16915:x1875336462736640:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460716.685806:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460716.685826:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650e6d55e00/0x889bb893541b8dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1852 expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.685855:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650e6d55e00/0x889bb893541b8dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1852 expref: 12 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.685865:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650e6d55e00/0x889bb893541b8dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1852 expref: 12 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.685874:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55e00, rc 0) 00000100:00100000:2.0:1788460716.685934:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462736640:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 404us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.685942:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 106 00000100:00100000:2.0:1788460716.688878:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.689017:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736768 00000100:00100000:3.0:1788460716.689027:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736768 00000100:00100000:3.0:1788460716.689079:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:3.0:1788460716.689089:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462736768:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788460716.689423:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462736768:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 335us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.689441:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 107 00000100:00100000:0.0:1788460716.698148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.698267:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462736896 00000100:00100000:2.0:1788460716.698276:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462736896 00000100:00100000:2.0:1788460716.698331:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:2.0:1788460716.698341:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462736896:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788460716.698765:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462736896:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 424us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.698773:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 108 00000100:00100000:0.0:1788460716.704164:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.704580:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737024 00000100:00100000:1.0:1788460716.704590:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737024 00000100:00100000:1.0:1788460716.704644:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:1.0:1788460716.704655:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+12:16921:x1875336462737024:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460716.704978:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+12:16921:x1875336462737024:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 324us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.704987:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 109 00000100:00100000:1.0:1788460716.717875:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.718243:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737152 00000100:00100000:3.0:1788460716.718254:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737152 00000100:00100000:3.0:1788460716.718319:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:3.0:1788460716.718329:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+12:16921:x1875336462737152:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460716.718644:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+12:16921:x1875336462737152:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 315us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.718653:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 110 00000100:00100000:0.0:1788460716.722213:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.722278:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737280 00000100:00100000:2.0:1788460716.722288:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737280 00000100:00100000:2.0:1788460716.722336:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:2.0:1788460716.722346:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+12:16915:x1875336462737280:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460716.722361:0:19029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460716.722378:0:19029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650e6d55200/0x889bb893541b8dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d187c expref: -99 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.722407:0:19029:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650e6d55200/0x889bb893541b8dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d187c expref: 13 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.722418:0:19029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650e6d55200/0x889bb893541b8dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d187c expref: 13 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460716.722428:0:19029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55200, rc 0) 00000100:00100000:2.0:1788460716.722532:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+13:16915:x1875336462737280:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 186us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.722539:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 111 00000100:00100000:0.0:1788460716.728118:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.728219:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737408 00000100:00100000:3.0:1788460716.728233:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737408 00000100:00100000:2.0:1788460716.728367:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:2.0:1788460716.728394:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+13:16915:x1875336462737408:12345-192.168.203.32@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788460716.728419:0:19027:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788460716.728435:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460716.728438:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788460716.728442:0:19027:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788460716.728444:0:19027:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788460716.732498:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+13:16915:x1875336462737408:12345-192.168.203.32@tcp:256:mount.lustre.0 Request processed in 4095us (4380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.732514:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 112 00000100:00100000:0.0:1788460716.738250:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.738858:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737536 00000100:00100000:3.0:1788460716.738869:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737536 00000100:00100000:3.0:1788460716.738974:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:3.0:1788460716.738984:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+13:16915:x1875336462737536:12345-192.168.203.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460716.739002:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460716.739020:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1883 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.739051:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 14 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.739062:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 14 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460716.739071:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4c00, rc 0) 00000100:00100000:3.0:1788460716.739147:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:16915:x1875336462737536:12345-192.168.203.32@tcp:101:mount.lustre.0 Request processed in 164us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.739173:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 113 00000100:00100000:0.0:1788460716.742363:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.743074:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737664 00000100:00100000:2.0:1788460716.743086:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737664 00000100:00100000:2.0:1788460716.743148:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:2.0:1788460716.743158:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16915:x1875336462737664:12345-192.168.203.32@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460716.744145:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16915:x1875336462737664:12345-192.168.203.32@tcp:501:mount.lustre.0 Request processed in 984us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.744157:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 114 00000100:00100000:1.0:1788460716.745837:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.745921:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737792 00000100:00100000:3.0:1788460716.745930:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737792 00000100:00100000:3.0:1788460716.745980:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:3.0:1788460716.745988:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:16915:x1875336462737792:12345-192.168.203.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788460716.746374:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:16915:x1875336462737792:12345-192.168.203.32@tcp:503:mount.lustre.0 Request processed in 386us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.746382:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 115 00000100:00100000:0.0:1788460716.748967:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.749204:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462737920 00000100:00100000:2.0:1788460716.749214:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462737920 00000100:00100000:2.0:1788460716.749268:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:2.0:1788460716.749277:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16923:x1875336462737920:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460716.749564:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16923:x1875336462737920:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 287us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.749582:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 116 00000100:00100000:0.0:1788460716.765050:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.766711:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738048 00000100:00100000:3.0:1788460716.766724:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738048 00000100:00100000:3.0:1788460716.766793:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:3.0:1788460716.766803:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:16923:x1875336462738048:12345-192.168.203.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460716.767472:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:16923:x1875336462738048:12345-192.168.203.32@tcp:502:llog_process_th.0 Request processed in 667us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.767481:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 117 00000100:00100000:1.0:1788460716.777892:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.778171:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.778225:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738176 00000100:00100000:1.0:1788460716.778235:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738176 00000100:00100000:1.0:1788460716.778273:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738560 00000100:00100000:1.0:1788460716.778276:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738560 00000100:00100000:2.0:1788460716.778291:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1788460716.778301:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2378:x1875336462738176:12345-192.168.203.32@tcp:38:mount.lustre.0 00000100:00100000:1.0:1788460716.778310:0:19036:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788460716.778319:0:19036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1788460716.778338:0:19034:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from e6a6dc80-b95c-4d0f-8c3e-bf625122869e@192.168.203.32@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:2.0:1788460716.778378:0:19034:0:(genops.c:1385:class_connect()) connect: client e6a6dc80-b95c-4d0f-8c3e-bf625122869e, cookie 0x889bb893541b8dd2 00000004:00100000:2.0:1788460716.778406:0:19034:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788460716.778524:0:19034:0:(import.c:65:import_set_state_nolock()) ffff964fc233d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460716.778593:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d108c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2378:x1875336462738176:12345-192.168.203.32@tcp:38:mount.lustre.0 Request processed in 292us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.778601:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1788460716.778619:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1788460716.778630:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2379:x1875336462738560:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460716.778658:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2379:x1875336462738560:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 33us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460716.778664:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1788460716.780915:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460716.781016:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738304 00000100:00100000:0.0:1788460716.781025:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738304 00000100:00100000:0.0:1788460716.781093:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460716.781102:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:0:x1875336462738304:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788460716.781138:0:19036:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788460716.781225:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:0:x1875336462738304:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 125us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.781247:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00080000:2.0:1788460716.781512:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460716.782883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.783308:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738432 00000100:00100000:1.0:1788460716.783317:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738432 00000100:00100000:1.0:1788460716.783503:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460716.783516:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462738432:12345-192.168.203.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788460716.783609:0:19035:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788460716.783676:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462738432:12345-192.168.203.32@tcp:41:mount.lustre.0 Request processed in 163us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.785049:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460716.789371:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460716.789649:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738688 00000100:00100000:1.0:1788460716.789659:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738688 00000100:00100000:1.0:1788460716.789716:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1788460716.789726:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462738688:12345-192.168.203.32@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788460716.789809:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462738688:12345-192.168.203.32@tcp:40:mount.lustre.0 Request processed in 84us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460716.789817:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460716.796052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.796091:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460716.796144:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460716.796253:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738816 00000100:00100000:3.0:1788460716.796262:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738816 00000100:00100000:3.0:1788460716.796302:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462738944 00000100:00100000:3.0:1788460716.796305:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462738944 00000100:00100000:3.0:1788460716.796332:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460716.796341:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462738816:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460716.796371:0:19719:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from e6a6dc80-b95c-4d0f-8c3e-bf625122869e@192.168.203.32@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1788460716.796397:0:19719:0:(genops.c:1385:class_connect()) connect: client e6a6dc80-b95c-4d0f-8c3e-bf625122869e, cookie 0x889bb893541b8dd9 00002000:00100000:3.0:1788460716.796418:0:19719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6a6dc80-b95c-4d0f-8c3e-bf625122869e/ffff9650f5fa0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460716.796429:0:19719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460716.796536:0:19719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788460716.796564:0:19719:0:(import.c:65:import_set_state_nolock()) ffff9650f5fa3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460716.796647:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2378:x1875336462738816:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 305us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.796654:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:3.0:1788460716.796671:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:3.0:1788460716.796676:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2378:x1875336462738944:12345-192.168.203.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460716.796691:0:19719:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from e6a6dc80-b95c-4d0f-8c3e-bf625122869e@192.168.203.32@tcp t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:3.0:1788460716.796707:0:19719:0:(genops.c:1385:class_connect()) connect: client e6a6dc80-b95c-4d0f-8c3e-bf625122869e, cookie 0x889bb893541b8de0 00002000:00100000:3.0:1788460716.796712:0:19719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6a6dc80-b95c-4d0f-8c3e-bf625122869e/ffff9650f5fa6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460716.796718:0:19719:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460716.796896:0:19719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460716.796911:0:19719:0:(import.c:65:import_set_state_nolock()) ffff9650f5fa7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460716.796935:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2378:x1875336462738944:12345-192.168.203.32@tcp:8:mount.lustre.0 Request processed in 257us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460716.796943:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460716.797584:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739072 00000100:00100000:0.0:1788460716.797592:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739072 00000100:00100000:0.0:1788460716.797636:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460716.797644:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462739072:12345-192.168.203.32@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788460716.797771:0:19038:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788460716.797819:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16915:x1875336462739072:12345-192.168.203.32@tcp:33:mount.lustre.0 Request processed in 176us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460716.797825:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:2.0:1788460717.043984:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460717.044139:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739200 00000100:00100000:1.0:1788460717.044150:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739200 00000100:00100000:1.0:1788460717.044241:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1788460717.044253:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:16945:x1875336462739200:12345-192.168.203.32@tcp:101:mkdir.0 00010000:00010000:1.0:1788460717.044274:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460717.044296:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b8de7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18ad expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044362:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044389:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044403:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460717.044440:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788460717.044444:0:19035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460717.044465:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044490:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb4200/0x889bb893541b8de7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 8 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044508:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 7 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460717.044516:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:1.0:1788460717.044519:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460717.044523:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650c3fb5800, rc 0) 00000100:00100000:1.0:1788460717.044596:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+7:16945:x1875336462739200:12345-192.168.203.32@tcp:101:mkdir.0 Request processed in 346us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460717.044604:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:1.0:1788460717.453623:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460718.476633:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460718.607134:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460718.607159:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482660480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460718.607624:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460718.616023:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660480 00000100:00100000:3.0:1788460718.616036:0:19724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660480 00000100:00080000:3.0:1788460718.616070:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460718.616115:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460718.616125:0:19724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482660480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460718.616158:0:19724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788460718.616259:0:19724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482660480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (8635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460718.616267:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460718.616330:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482660480:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788460718.665527:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 070896ab-fc36-4f97-80f6-7a8728f1dddc 00000001:00100000:3.0:1788460718.665541:0:6730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6a6dc80-b95c-4d0f-8c3e-bf625122869e 00000001:00100000:3.0:1788460719.187001:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 070896ab-fc36-4f97-80f6-7a8728f1dddc 00000001:00100000:3.0:1788460719.187016:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6a6dc80-b95c-4d0f-8c3e-bf625122869e 00010000:00010000:2.0:1788460719.500348:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460720.122038:0:20999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788460720.526831:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460721.101293:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788460721.548695:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460721.676324:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482660608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460721.676397:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460721.676477:0:19724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660608 00000100:00100000:3.0:1788460721.676493:0:19724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660608 00000100:00100000:3.0:1788460721.676562:0:19724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460721.676574:0:19724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482660608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460721.676604:0:19724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788460721.676660:0:19724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482660608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460721.676669:0:19724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788460721.676708:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460721.676739:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788460721.676762:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482660608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460721.677807:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482660864:0@lo:400:kworker.0 00000100:00100000:2.0:1788460721.677847:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460721.677875:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460721.677881:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482660992:0@lo:400:kworker.0 00000100:00100000:2.0:1788460721.677904:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460721.677935:0:19719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660864 00000100:00100000:2.0:1788460721.677940:0:19719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660864 00000100:00100000:1.0:1788460721.678671:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482660736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.678747:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460721.678785:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482661248:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.678807:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460721.678826:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460721.678832:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482661120:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.678852:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460721.678877:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660992 00000100:00100000:1.0:1788460721.678881:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660992 00000100:00100000:1.0:1788460721.678912:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482661248 00000100:00100000:1.0:1788460721.678915:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482661248 00000100:00100000:1.0:1788460721.678928:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482661120 00000100:00100000:1.0:1788460721.678930:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482661120 00000100:00100000:1.0:1788460721.678944:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460721.678951:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482660992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.679343:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482660992:12345-0@lo:400:kworker.0 Request processed in 391us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460721.679439:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788460721.679447:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460721.679479:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1875336482661248:12345-0@lo:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460721.679774:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482660736 00000100:00100000:3.0:1788460721.679779:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482660736 00000100:00100000:3.0:1788460721.679808:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788460721.679814:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:3317:x1875336482660736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460721.679855:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:3317:x1875336482660736:12345-0@lo:400:kworker.0 Request processed in 42us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460721.679862:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788460721.679890:0:20910:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788460721.679897:0:20910:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1788460721.679982:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460721.679986:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460721.690893:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460721.690942:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460721.690968:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482661120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.691050:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1875336482661120:12345-0@lo:400:kworker.0 Request processed in 100us (12197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.691057:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460721.691124:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5006a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482660992:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.691171:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5006680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3317:1875336482661120:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.691673:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5005500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482660736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.691685:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5007b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3317:1875336482661248:0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.693483:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460721.693495:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482660864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460721.693585:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482660864:12345-0@lo:400:kworker.0 Request processed in 92us (15737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.693601:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460721.693669:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5007100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482660864:0@lo:400:kworker.0 00000100:00100000:2.0:1788460721.708358:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000001:00100000:0.0:1788460721.825080:0:7671:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6a6dc80-b95c-4d0f-8c3e-bf625122869e 00000100:00100000:2.0:1788460721.897046:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460721.897087:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460721.897121:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460721.897138:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460721.897155:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460721.897170:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460721.897336:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739328 00000100:00100000:1.0:1788460721.897346:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739328 00000100:00100000:1.0:1788460721.897389:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1788460721.897398:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:2381:x1875336462739328:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460721.897559:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739584 00000100:00100000:3.0:1788460721.897564:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739584 00000100:00100000:3.0:1788460721.897598:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740096 00000100:00100000:3.0:1788460721.897602:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740096 00000100:00100000:3.0:1788460721.897613:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739712 00000100:00100000:3.0:1788460721.897616:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739712 00000100:00100000:3.0:1788460721.897627:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:3.0:1788460721.897633:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2381:x1875336462739584:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.901196:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:2381:x1875336462739328:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 3775us (4136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.901828:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 119 00000100:00100000:1.0:1788460721.901884:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739840 00000100:00100000:1.0:1788460721.901891:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739840 00000100:00100000:1.0:1788460721.901937:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739456 00000100:00100000:1.0:1788460721.901940:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739456 00000100:00100000:1.0:1788460721.902615:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460721.902627:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2381:x1875336462739840:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.902705:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2381:x1875336462739840:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (5582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.902712:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460721.902740:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460721.902746:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2381:x1875336462739456:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.904240:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2381:x1875336462739456:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 1486us (7076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.904251:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460721.904291:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460721.904301:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2381:x1875336462740096:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.904335:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2381:x1875336462740096:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 37us (7195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.904341:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:1.0:1788460721.904355:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:1.0:1788460721.904361:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2381:x1875336462739712:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.904383:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2381:x1875336462739712:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 22us (7212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.904389:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1788460721.905261:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2381:x1875336462739584:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 7623us (8168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460721.905270:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00080000:3.0:1788460721.905298:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460721.905303:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460721.905306:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460721.905549:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460721.906504:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462739968 00000100:00100000:1.0:1788460721.906515:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462739968 00000100:00100000:1.0:1788460721.906577:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460721.906586:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2381:x1875336462739968:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:1.0:1788460721.906647:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2381:x1875336462739968:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 62us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460721.906654:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00080000:3.0:1788460721.907627:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788460722.573542:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460723.596497:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460723.738622:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460723.738656:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482661376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460723.738715:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460723.738773:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482661376 00000100:00100000:1.0:1788460723.738780:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482661376 00000100:00100000:1.0:1788460723.739036:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460723.739046:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482661376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460723.739075:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460723.739117:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482661376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460723.739124:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788460723.739145:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460723.739197:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482661376:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788460724.441151:0:21148:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb7f5aa40 20000000:00000080:3.0:1788460724.441170:0:21148:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff964fc34c6400 uarg=0000000000000000 20000000:01000000:3.0:1788460724.441259:0:21148:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788460724.441265:0:21148:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788460724.441270:0:21148:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788460724.442669:0:21149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788460724.443230:0:21148:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788460724.454840:0:21148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788460724.454872:0:21148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454893:0:21148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8a44 expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454902:0:21148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8aad expref: 22 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454909:0:21148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454919:0:21148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454946:0:21148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 13 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454953:0:21148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.454998:0:21148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 13 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.455016:0:21148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 13 pid: 19028 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.455031:0:21148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661504:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460724.455310:0:21148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.455319:0:21148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.455329:0:21148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661632:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460724.455366:0:21148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.455375:0:21148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.455384:0:21148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661760:0@lo:104: 00000100:00100000:1.0:1788460724.456269:0:21148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460724.456326:0:21148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 22 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.456337:0:21148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 22 pid: 19027 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.456347:0:21148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661888:0@lo:104: 00010000:00010000:1.0:1788460724.456375:0:21148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 22 pid: 19029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.456383:0:21148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 22 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460724.456508:0:19017:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788460724.456538:0:19017:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460724.456562:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482661760 00000100:00100000:3.0:1788460724.456568:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482661760 00000100:00100000:3.0:1788460724.456609:0:19017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482661888 00000100:00100000:3.0:1788460724.456612:0:19017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482661888 00000100:00100000:3.0:1788460724.456625:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460724.456633:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc36b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+4:21148:x1875336482661760:12345-0@lo:104: 00010000:00010000:3.0:1788460724.456647:0:19017:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456696:0:19017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460724.456702:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc36b2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+4:21148:x1875336482661760:12345-0@lo:104: Request processed in 70us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460724.456709:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460724.456759:0:19017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460724.456766:0:19017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+3:21148:x1875336482661888:12345-0@lo:104: 00010000:00010000:3.0:1788460724.456773:0:19017:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456806:0:19017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788460724.456811:0:19017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:13026af2-46ad-415c-9f59-ba32734436e0+3:21148:x1875336482661888:12345-0@lo:104: Request processed in 47us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460724.456817:0:19017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788460724.456833:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460724.456839:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456846:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb5c00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460724.456850:0:19022:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456868:0:19022:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460724.456875:0:19022:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460724.456881:0:19022:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460724.456907:0:19022:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456914:0:19022:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460724.456935:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456943:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb5c00/0x889bb893541b8c2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8c35 expref: -99 pid: 20437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456957:0:19022:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460724.456960:0:19022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456965:0:19022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4800 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:3.0:1788460724.456968:0:19022:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.456974:0:19022:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460724.456980:0:19022:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460724.456991:0:19022:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788460724.457005:0:19022:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457010:0:19022:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460724.457025:0:19022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457031:0:19022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4800/0x889bb893541b8aad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8ab4 expref: -99 pid: 19718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457039:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460724.457041:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460724.457042:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460724.457054:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482662144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460724.457081:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460724.457123:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482662272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460724.457145:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460724.457172:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662144 00000100:00100000:3.0:1788460724.457175:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662144 00010000:00010000:3.0:1788460724.457213:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 23 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460724.457232:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662272 00000100:00100000:3.0:1788460724.457234:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662272 00010000:00010000:3.0:1788460724.457244:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 24 pid: 19027 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460724.457256:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460724.457269:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+24:3319:x1875336482662144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460724.457280:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460724.457285:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 24 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457294:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 24 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457308:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460724.457335:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+24:3319:x1875336482662144:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460724.457342:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460724.457355:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460724.457360:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482662272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460724.457367:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460724.457371:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 23 pid: 19027 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457379:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 23 pid: 19027 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460724.457388:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460724.457486:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482662272:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460724.457493:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460724.457532:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482662272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460724.457556:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482662144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460724.457612:0:21148:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482662016:0@lo:104: 00000100:00100000:1.0:1788460724.457640:0:21148:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460724.457669:0:21148:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100480 going to sleep for 11 seconds 00010000:00010000:1.0:1788460724.457682:0:21148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc5600/0x889bb893541b8c35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8c2e expref: 22 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.457692:0:21148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661760:0@lo:104: 00010000:00010000:1.0:1788460724.457701:0:21148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff964fc1ea4000/0x889bb893541b8ab4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8aad expref: 21 pid: 19027 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.457709:0:21148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661888:0@lo:104: 00010000:00010000:1.0:1788460724.457749:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460724.457985:0:20450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662016 00000100:00100000:0.0:1788460724.457990:0:20450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662016 00000100:00100000:0.0:1788460724.458013:0:20450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460724.458020:0:20450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13026af2-46ad-415c-9f59-ba32734436e0+3:21148:x1875336482662016:12345-0@lo:104: 00010000:00010000:0.0:1788460724.458030:0:20450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458078:0:20450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460724.458084:0:20450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:13026af2-46ad-415c-9f59-ba32734436e0+3:21148:x1875336482662016:12345-0@lo:104: Request processed in 65us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460724.458090:0:20450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788460724.458111:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460724.458116:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458136:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650c3fb4e00 already unused, calling callback (ffffffffc1d1ce00) 10000000:00010000:0.0:1788460724.458139:0:20262:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458147:0:20262:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460724.458154:0:20262:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460724.458160:0:20262:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460724.458207:0:20262:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458213:0:20262:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460724.458226:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458233:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.203.132@tcp lock: ffff9650c3fb4e00/0x889bb893541b8a44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x889bb893541b8a4b expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458246:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460724.458248:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460724.458249:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460724.458259:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482662400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460724.458286:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460724.458318:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662400 00000100:00100000:0.0:1788460724.458322:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662400 00010000:00010000:0.0:1788460724.458335:0:19021:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 21 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460724.458362:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460724.458369:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+21:3317:x1875336482662400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460724.458377:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460724.458381:0:19021:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 21 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458389:0:19021:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 21 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460724.458414:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460724.458443:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13026af2-46ad-415c-9f59-ba32734436e0+21:3317:x1875336482662400:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460724.458448:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460724.458474:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:13026af2-46ad-415c-9f59-ba32734436e0:3317:1875336482662400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460724.458611:0:21148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650ec008000/0x889bb893541b8a4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x889bb893541b8a44 expref: 20 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460724.458621:0:21148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482662016:0@lo:104: 00000100:00100000:0.0:1788460724.462909:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460724.462944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460724.463026:0:21148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661504:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460724.463054:0:21148:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21148:1875336482661632:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460724.463088:0:21148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460724.463151:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740224 00000100:00100000:2.0:1788460724.463159:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740224 00010000:00010000:2.0:1788460724.463221:0:19020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 14 pid: 19028 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460724.463257:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740352 00000100:00100000:2.0:1788460724.463260:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740352 00010000:00010000:2.0:1788460724.463272:0:19020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 15 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460724.463286:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460724.463294:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33947916-367f-49ef-b7e1-278b016d1427+15:2379:x1875336462740224:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460724.463307:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460724.463312:0:19020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 15 pid: 19028 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463330:0:19020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 15 pid: 19028 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463347:0:19020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650efdc4c00/0x889bb893541b8dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1883 expref: 15 pid: 19028 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463361:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460724.463524:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33947916-367f-49ef-b7e1-278b016d1427+14:2379:x1875336462740224:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 221us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460724.463533:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:2.0:1788460724.463550:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1788460724.463557:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33947916-367f-49ef-b7e1-278b016d1427+13:2379:x1875336462740352:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460724.463565:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460724.463570:0:19020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463579:0:19020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463589:0:19020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650c3fb4600/0x889bb893541b8d8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d181a expref: 13 pid: 19029 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463601:0:19020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463608:0:19020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463634:0:19020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463641:0:19020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463648:0:19020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463655:0:19020:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463661:0:19020:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029dc00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460724.463665:0:19020:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463673:0:19020:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463684:0:19020:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.463693:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460724.463713:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:33947916-367f-49ef-b7e1-278b016d1427+12:2379:x1875336462740352:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 157us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460724.463719:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00010000:00010000:1.0:1788460724.463872:0:21148:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.463881:0:21148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460724.463887:0:21148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9650d029dc00/0x889bb893541b8df5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460724.620490:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460725.644540:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460725.680172:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460725.680360:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740480 00000100:00100000:3.0:1788460725.680592:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740480 00000100:00100000:3.0:1788460725.680747:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:3.0:1788460725.680758:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+12:16801:x1875336462740480:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460725.680780:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460725.680806:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc5a00/0x889bb893541b8dfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18b4 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.680832:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc5a00/0x889bb893541b8dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18b4 expref: 13 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.680843:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc5a00/0x889bb893541b8dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18b4 expref: 13 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.680853:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5a00, rc 0) 00000100:00100000:3.0:1788460725.681023:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740480:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 267us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.681031:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 120 00000100:00100000:1.0:1788460725.701611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460725.701697:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740608 00000100:00100000:3.0:1788460725.701707:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740608 00000100:00100000:3.0:1788460725.701761:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 121 00000100:00100000:3.0:1788460725.701770:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740608:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.702331:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740608:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 558us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.702341:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 121 10000000:01000000:0.0:1788460725.708372:0:19032:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788460725.708387:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650fde1e000 from 10 10000000:01000000:0.0:1788460725.708392:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788460725.708442:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460725.708642:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460725.708656:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460725.708767:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460725.708852:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460725.708916:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.710236:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662528 00000100:00100000:3.0:1788460725.710248:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662528 00000100:00100000:3.0:1788460725.710317:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788460725.710327:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+20:19032:x1875336482662528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460725.710352:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460725.710366:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650efdc4e00/0x889bb893541b8e0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8e03 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.710392:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650efdc4e00/0x889bb893541b8e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8e03 expref: 21 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.710402:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650efdc4e00/0x889bb893541b8e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8e03 expref: 21 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460725.710411:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4e00, rc 0) 00000100:00100000:3.0:1788460725.710478:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482662528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.710486:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788460725.710678:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fd3c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460725.710710:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e0a expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.710720:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8e0a expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460725.711488:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:1.0:1788460725.716756:0:19032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460725.717315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460725.718351:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740736 00000100:00100000:2.0:1788460725.718374:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740736 00000100:00100000:2.0:1788460725.718450:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 123 00000100:00100000:2.0:1788460725.718471:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740736:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.718717:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740736:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 256us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460725.718787:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 123 00000040:00080000:1.0:1788460725.722148:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788460725.722251:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:1.0:1788460725.722301:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:1.0:1788460725.722338:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:1.0:1788460725.722371:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:1.0:1788460725.722420:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:1.0:1788460725.722456:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:1.0:1788460725.722544:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:1.0:1788460725.722636:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:1.0:1788460725.722644:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:1.0:1788460725.722744:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.722812:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.725861:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460725.726661:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460725.743781:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662656 00000100:00100000:0.0:1788460725.743798:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662656 00000100:00100000:0.0:1788460725.743871:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740864 00000100:00100000:0.0:1788460725.743874:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740864 00000100:00100000:0.0:1788460725.743893:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788460725.743903:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482662656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.744282:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:1.0:1788460725.744296:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+13:16801:x1875336462740864:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460725.744308:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460725.744341:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029dc00/0x889bb893541b8e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18bb expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460725.744355:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482662656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 452us (21541us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460725.744370:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029dc00/0x889bb893541b8e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18bb expref: 14 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.744383:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029dc00/0x889bb893541b8e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18bb expref: 14 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.744394:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029dc00, rc 0) 00000100:00100000:1.0:1788460725.744453:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16801:x1875336462740864:12345-192.168.203.32@tcp:101:ll_cfg_requeue.0 Request processed in 162us (17797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460725.744461:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 125 00000100:00100000:2.0:1788460725.744664:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.744715:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.744764:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.744800:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662784 00000100:00100000:2.0:1788460725.744801:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c8e4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460725.744806:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662784 00000100:00100000:1.0:1788460725.744830:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788460725.744837:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c3c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482662784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.744998:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c3c63450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482662784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460725.745013:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788460725.745043:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788460725.745817:0:19032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460725.745880:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662912:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460725.747041:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788460725.747202:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460725.747241:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c8e4d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.747325:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482662912 00000100:00100000:3.0:1788460725.747332:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482662912 00000100:00100000:3.0:1788460725.747373:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460725.747382:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fca73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482662912:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.748239:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fca73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482662912:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 854us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.748248:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788460725.749538:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482662912:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460725.753888:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460725.754057:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462740992 00000100:00100000:3.0:1788460725.754067:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462740992 00000100:00100000:3.0:1788460725.754129:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1788460725.754141:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+14:16801:x1875336462740992:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 00000040:00080000:1.0:1788460725.754621:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:1.0:1788460725.754691:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:1.0:1788460725.754819:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:1.0:1788460725.754869:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:1.0:1788460725.754895:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:1.0:1788460725.754921:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:1.0:1788460725.754939:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:1.0:1788460725.754954:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000100:00100000:1.0:1788460725.754989:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663040:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.755045:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.755083:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.755580:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+14:16801:x1875336462740992:12345-192.168.203.32@tcp:501:ll_cfg_requeue.0 Request processed in 1437us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.755601:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 128 00000100:00100000:3.0:1788460725.755633:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663040 00000100:00100000:3.0:1788460725.755639:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663040 00000100:00100000:3.0:1788460725.755669:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460725.755676:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482663040:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.756235:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482663040:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 558us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.756243:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788460725.759579:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460725.760583:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663040:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460725.760781:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:1.0:1788460725.760796:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:2.0:1788460725.762059:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741120 00000100:00100000:2.0:1788460725.762070:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741120 00000100:00100000:2.0:1788460725.762127:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 130 00000100:00100000:2.0:1788460725.762138:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16801:x1875336462741120:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.762343:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:33947916-367f-49ef-b7e1-278b016d1427+14:16801:x1875336462741120:12345-192.168.203.32@tcp:503:ll_cfg_requeue.0 Request processed in 206us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460725.762352:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 130 00000040:00080000:0.0:1788460725.770364:0:21161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 64768 count 10 00000020:01000000:1.0:1788460725.770650:0:19032:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788460725.770665:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460725.770676:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e0a expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.770688:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff964fc1ea4200/0x889bb893541b8e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e0a expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460725.770703:0:19032:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460725.770706:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff9650f5c67000 from 10 10000000:01000000:1.0:1788460725.770709:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460725.770743:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.770762:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.770774:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460725.770800:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.770861:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.770906:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460725.771009:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663168 00000100:00100000:2.0:1788460725.771024:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663168 00000100:00100000:2.0:1788460725.771150:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788460725.771161:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+21:19032:x1875336482663168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460725.771175:0:19028:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460725.771221:0:19028:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650e6d54c00/0x889bb893541b8e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8e18 expref: -99 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.771245:0:19028:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650e6d54c00/0x889bb893541b8e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8e18 expref: 22 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.771256:0:19028:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650e6d54c00/0x889bb893541b8e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8e18 expref: 22 pid: 19028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.771264:0:19028:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54c00, rc 0) 00000100:00100000:2.0:1788460725.771301:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460725.771307:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788460725.771391:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460725.771405:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e1f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.771414:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8e1f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460725.774435:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 10 00000040:00080000:1.0:1788460725.775571:0:19032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460725.775798:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1788460725.775840:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:1.0:1788460725.775889:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:1.0:1788460725.775926:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:1.0:1788460725.775961:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:1.0:1788460725.776006:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:1.0:1788460725.776435:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:1.0:1788460725.776479:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:1.0:1788460725.776581:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1788460725.776591:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 9 count 10 00000100:00100000:1.0:1788460725.776693:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.776755:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.777137:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.779325:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663296 00000100:00100000:3.0:1788460725.779339:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663296 00000100:00100000:3.0:1788460725.779406:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788460725.779415:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.779726:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.779734:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788460725.779884:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.779946:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.779990:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.780026:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460725.780132:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663424 00000100:00100000:0.0:1788460725.780137:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663424 00000100:00100000:0.0:1788460725.780171:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788460725.780211:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460725.780357:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460725.780364:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788460725.780714:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460725.781333:0:19032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460725.782342:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663552:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.782412:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.782447:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460725.782523:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663552 00000100:00100000:2.0:1788460725.782529:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663552 00000100:00100000:2.0:1788460725.782587:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788460725.782596:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663552:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.782786:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663552:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 191us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460725.782793:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788460725.783613:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663552:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460725.783904:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1788460725.783966:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:1.0:1788460725.784004:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:1.0:1788460725.784031:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:1.0:1788460725.784266:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:1.0:1788460725.784317:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:1.0:1788460725.784352:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:1.0:1788460725.784384:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000100:00100000:1.0:1788460725.784422:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663680:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460725.784484:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460725.784534:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f6100780 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.785464:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663680 00000100:00100000:3.0:1788460725.785474:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663680 00000100:00100000:3.0:1788460725.785553:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788460725.785570:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663680:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.785813:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663680:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 252us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.785821:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788460725.786884:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663680:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460725.787401:0:19032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:1.0:1788460725.787416:0:19032:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000040:00080000:1.0:1788460725.790098:0:21162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 10 00000020:01000000:2.0:1788460725.790324:0:19032:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788460725.790337:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460725.790346:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e1f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.790373:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650d029c800/0x889bb893541b8e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e1f expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460725.790384:0:19032:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460725.790386:0:19032:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff964fc3bbd800 from 10 10000000:01000000:2.0:1788460725.790389:0:19032:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460725.790420:0:19032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.790427:0:19032:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.790437:0:19032:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460725.790459:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.790529:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460725.790589:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d06f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460725.790726:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663808 00000100:00100000:1.0:1788460725.790734:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663808 00000100:00100000:1.0:1788460725.790822:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788460725.790832:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+22:19032:x1875336482663808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460725.790845:0:19027:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460725.790859:0:19027:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9650d029c000/0x889bb893541b8e2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x889bb893541b8e26 expref: -99 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.790883:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9650d029c000/0x889bb893541b8e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x889bb893541b8e26 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.790895:0:19027:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9650d029c000/0x889bb893541b8e2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x889bb893541b8e26 expref: 23 pid: 19027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.790904:0:19027:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c000, rc 0) 00000100:00100000:1.0:1788460725.790959:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482663808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460725.790965:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788460725.791052:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460725.791066:0:19032:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e2d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460725.791075:0:19032:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x889bb893541b8e2d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460725.791108:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.791132:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460725.792089:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d06f76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.792315:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482663936 00000100:00100000:3.0:1788460725.792324:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482663936 00000100:00100000:3.0:1788460725.792360:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788460725.792368:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482663936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.792795:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482663936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.792803:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788460725.792979:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482663936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.793023:0:19032:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482664064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460725.793120:0:19032:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460725.793198:0:19032:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d06f76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460725.793347:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664064 00000100:00100000:3.0:1788460725.793352:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664064 00000100:00100000:3.0:1788460725.793379:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788460725.793385:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482664064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460725.793546:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:19032:x1875336482664064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460725.793554:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788460725.793693:0:19032:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:13026af2-46ad-415c-9f59-ba32734436e0:19032:1875336482664064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460725.794595:0:21163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788460725.794938:0:19032:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788460725.794949:0:19032:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.203.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460725.794959:0:19032:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e2d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460725.794970:0:19032:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.203.132@tcp lock: ffff9650e6d55600/0x889bb893541b8e26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x889bb893541b8e2d expref: -99 pid: 19032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460726.325941:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460726.326075:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741248 00000100:00100000:3.0:1788460726.326085:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741248 00000100:00100000:3.0:1788460726.326167:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460726.326212:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:17408:x1875336462741248:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460726.326233:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460726.326254:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8e34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18c2 expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326315:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326330:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326344:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326358:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326378:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.326391:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.326983:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54800/0x889bb893541b8e49 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.326995:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54800/0x889bb893541b8e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327004:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54800/0x889bb893541b8e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.327029:0:20910:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460726.327032:0:20910:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460726.327066:0:20910:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54800/0x889bb893541b8e49 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327077:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327084:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327090:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327096:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.327101:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327120:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327132:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:2.0:1788460726.327135:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.327139:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327145:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b8e3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327159:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327165:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327171:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327176:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.327223:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327230:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327238:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9650c52ede00) 00010000:00010000:2.0:1788460726.327241:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.327244:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327260:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8e42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327297:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8e34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18c2 expref: 8 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327311:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54800/0x889bb893541b8e49 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18c2 expref: 7 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.327317:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0d00) 00010000:00010000:2.0:1788460726.327320:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460726.327322:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54800, rc 0) 00000100:00100000:2.0:1788460726.327388:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:17408:x1875336462741248:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1212us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.327397:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00080000:1.0:1788460726.328049:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460726.338129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.338592:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741504 00000100:00100000:1.0:1788460726.338603:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741504 00000100:00100000:1.0:1788460726.338666:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1788460726.338676:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:17408:x1875336462741504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460726.338697:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460726.338731:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18c9 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338807:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338822:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338835:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338849:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338856:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.338863:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.339421:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8e65 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.339438:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.339446:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8e65 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460726.339456:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788460726.339708:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.339716:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341070:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341077:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029ce00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460726.341082:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341091:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341107:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9650c34d0d00) 00010000:00010000:1.0:1788460726.341110:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460726.341114:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341121:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ce00/0x889bb893541b8e57 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341137:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341156:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341163:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341167:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029de00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460726.341170:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341212:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341222:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9650e70d8100) 00010000:00010000:1.0:1788460726.341224:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460726.341228:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341233:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341786:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d400/0x889bb893541b8e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18c9 expref: 10 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341803:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d000/0x889bb893541b8e65 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18c9 expref: 9 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.341811:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:1.0:1788460726.341814:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460726.341823:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d000, rc 0) 00000100:00100000:1.0:1788460726.341895:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17408:x1875336462741504:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 3219us (3774us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788460726.341905:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:0.0:1788460726.346601:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.346918:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741632 00000100:00100000:1.0:1788460726.346929:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741632 00000100:00100000:1.0:1788460726.346983:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:1.0:1788460726.346992:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17408:x1875336462741632:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788460726.347131:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17408:x1875336462741632:12345-192.168.203.32@tcp:59:lhsmtool_posix.0 Request processed in 140us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460726.347139:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460726.390767:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460726.390912:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741760 00000100:00100000:3.0:1788460726.390921:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741760 00000100:00100000:3.0:1788460726.390996:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460726.391008:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17414:x1875336462741760:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460726.391048:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460726.391067:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8e73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18d0 expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391129:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391144:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391154:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391250:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391259:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391266:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391441:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391447:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391451:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391454:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460726.391457:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391462:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391471:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:3.0:1788460726.391473:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460726.391476:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391480:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8e7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391492:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391497:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391513:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391524:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460726.391527:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391534:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391542:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9650c52ed500) 00010000:00010000:3.0:1788460726.391545:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460726.391547:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391554:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8e81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391587:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8e73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18d0 expref: 10 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391597:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:3.0:1788460726.391599:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460726.391603:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8e73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18d0 expref: 10 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.391613:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4200, rc 0) 00000100:00100000:3.0:1788460726.391671:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17414:x1875336462741760:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 666us (913us total) trans 0 rc 301/301 00000100:00100000:3.0:1788460726.391677:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1788460726.397405:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.397603:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462741888 00000100:00100000:2.0:1788460726.397614:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462741888 00000100:00100000:2.0:1788460726.397704:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:2.0:1788460726.397716:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17414:x1875336462741888:12345-192.168.203.32@tcp:700:lfs.0 00000100:00100000:2.0:1788460726.397807:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17414:x1875336462741888:12345-192.168.203.32@tcp:700:lfs.0 Request processed in 93us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.397816:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:0.0:1788460726.400253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.400633:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742144 00000100:00100000:1.0:1788460726.400643:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742144 00000100:00100000:1.0:1788460726.400703:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:1.0:1788460726.400714:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17414:x1875336462742144:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:1.0:1788460726.400773:0:19035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460726.400800:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4c00/0x889bb893541b8daf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1844 expref: 9 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.400820:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:1.0:1788460726.400825:0:19035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460726.401656:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.401675:0:19035:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 5 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.401697:0:19035:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.401732:0:19035:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 5 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.401746:0:19035:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 5 pid: 19035 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460726.401759:0:19035:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19035:1875336482664192:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460726.401864:0:19035:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650f61006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460726.403718:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460726.403799:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742272 00000100:00100000:0.0:1788460726.403807:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742272 00010000:00010000:0.0:1788460726.403859:0:19020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 6 pid: 19035 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460726.403898:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460726.403905:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2380:x1875336462742272:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460726.403916:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460726.403921:0:19020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 6 pid: 19035 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.403939:0:19020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 6 pid: 19035 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.403954:0:19020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:0.0:1788460726.403958:0:19020:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.403964:0:19020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.403969:0:19020:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.403982:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460726.404049:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2380:x1875336462742272:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 143us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460726.404058:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00080000:1.0:1788460726.404233:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460726.404365:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650c3fb5800/0x889bb893541b8dee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ad expref: 5 pid: 19035 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460726.404388:0:19035:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19035:1875336482664192:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460726.404407:0:19035:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.404413:0:19035:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.404417:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.404432:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.404438:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.404443:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.405459:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460726.405472:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405481:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405488:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405493:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029de00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.405514:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405523:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405535:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c7412900) 00010000:00010000:2.0:1788460726.405538:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.405542:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.405549:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b8e88 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460726.405568:0:19035:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db76f9da reply state 000000006ecca146 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460726.405577:0:19035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460726.405666:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+10:17414:x1875336462742144:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 4951us (5419us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788460726.405676:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00010000:00010000:0.0:1788460726.407396:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407411:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407420:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407426:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460726.407429:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407437:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407450:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9650c34d0b00) 00010000:00010000:0.0:1788460726.407453:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460726.407456:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.407463:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8e8f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460726.466159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.466474:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742400 00000100:00100000:2.0:1788460726.466486:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742400 00000100:00100000:2.0:1788460726.466611:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:2.0:1788460726.466624:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:17422:x1875336462742400:12345-192.168.203.32@tcp:101:lctl.0 00010000:00010000:2.0:1788460726.466654:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.466680:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18d7 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466744:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55a00/0x889bb893541b8e9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466771:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55a00/0x889bb893541b8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466781:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55a00/0x889bb893541b8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.466817:0:19034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460726.466821:0:19034:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460726.466855:0:19034:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55a00/0x889bb893541b8e9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466878:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18d7 expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466895:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55a00/0x889bb893541b8e9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18d7 expref: 10 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.466903:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460726.466906:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460726.466909:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55a00, rc 0) 00000100:00100000:2.0:1788460726.466970:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+10:17422:x1875336462742400:12345-192.168.203.32@tcp:101:lctl.0 Request processed in 350us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.466977:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:1.0:1788460726.499057:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.499535:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742528 00000100:00100000:2.0:1788460726.499546:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742528 00000100:00100000:2.0:1788460726.499614:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:2.0:1788460726.499625:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:17423:x1875336462742528:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460726.499644:0:21022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.499678:0:21022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8ea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18de expref: -99 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499747:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54600/0x889bb893541b8eab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499761:0:21022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54600/0x889bb893541b8eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499773:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54600/0x889bb893541b8eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.499812:0:21022:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460726.499816:0:21022:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460726.499833:0:21022:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54600/0x889bb893541b8eab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499868:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8ea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18de expref: 7 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499888:0:21022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54600/0x889bb893541b8eab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18de expref: 6 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.499897:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460726.499900:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460726.499904:0:21022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54600, rc 0) 00000100:00100000:2.0:1788460726.501671:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:17423:x1875336462742528:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2039us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.501684:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 21 00000100:00100000:0.0:1788460726.504687:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.504769:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742656 00000100:00100000:2.0:1788460726.504794:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742656 00000100:00100000:2.0:1788460726.504861:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:2.0:1788460726.504873:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:17423:x1875336462742656:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460726.504895:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.504917:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b8eb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18e5 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505000:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505015:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505033:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505049:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505057:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505063:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505165:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505174:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505212:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.505248:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460726.505251:0:19035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460726.505269:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505281:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505288:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505295:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505301:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.505304:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505311:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505324:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460726.505327:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.505331:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505337:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8eb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505352:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505366:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505371:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505376:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.505379:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505384:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505392:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9650c34d0600) 00010000:00010000:2.0:1788460726.505394:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.505397:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505402:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8ec0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505436:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b8eb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18e5 expref: 8 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505449:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18e5 expref: 7 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.505456:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c34d0700) 00010000:00010000:2.0:1788460726.505458:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460726.505468:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54200, rc 0) 00000100:00100000:2.0:1788460726.505923:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+7:17423:x1875336462742656:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 1051us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.505931:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 22 00000100:00100000:0.0:1788460726.511864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.511914:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462742912 00000100:00100000:2.0:1788460726.511925:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462742912 00000100:00100000:2.0:1788460726.511983:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:2.0:1788460726.511993:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+7:17423:x1875336462742912:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460726.512015:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.512036:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8ece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18ec expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.512121:0:19034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460726.512280:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8ece lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ec expref: 9 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.512293:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460726.512296:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460726.512301:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8ece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18ec expref: 9 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.512315:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54a00, rc 0) 00000100:00100000:2.0:1788460726.512374:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+8:17423:x1875336462742912:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 382us (518us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788460726.512380:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 23 00000100:00100000:1.0:1788460726.523714:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.523817:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462743168 00000100:00100000:2.0:1788460726.523827:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462743168 00000100:00100000:2.0:1788460726.523884:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:2.0:1788460726.523909:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+8:17423:x1875336462743168:12345-192.168.203.32@tcp:36:lfs.0 00010000:00010000:2.0:1788460726.523979:0:19036:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460726.524005:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8ec7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18e5 expref: 8 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.524026:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c34d0700) 00010000:00010000:2.0:1788460726.524037:0:19036:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460726.524060:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.524074:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.524083:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460726.524346:0:19036:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009babb943 reply state 00000000638d19c0 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460726.524355:0:19036:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788460726.524363:0:19036:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788460726.524642:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+9:17423:x1875336462743168:12345-192.168.203.32@tcp:36:lfs.0 Request processed in 734us (941us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788460726.524649:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 24 00000100:00100000:0.0:1788460726.528067:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.528233:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462743424 00000100:00100000:1.0:1788460726.528244:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462743424 00000100:00100000:1.0:1788460726.528305:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1788460726.528316:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+9:17423:x1875336462743424:12345-192.168.203.32@tcp:35:lfs.0 00010000:00010000:3.0:1788460726.528615:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528635:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528643:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528649:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54a00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460726.528654:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528661:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528674:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c34d0600) 00010000:00010000:3.0:1788460726.528677:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788460726.528682:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.528688:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8edc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460726.530298:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+9:17423:x1875336462743424:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1977us (2235us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788460726.530309:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1788460726.537861:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460726.538759:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462743680 00000100:00100000:3.0:1788460726.538770:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462743680 00000100:00100000:3.0:1788460726.538840:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:3.0:1788460726.538852:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+9:17423:x1875336462743680:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460726.538876:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460726.538897:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8ee3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18f3 expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.538981:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539013:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539026:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539043:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539051:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539058:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460726.539165:0:20910:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788460726.539406:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539414:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539421:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539427:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460726.539430:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539437:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539457:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460726.539460:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460726.539465:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539481:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8eea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539496:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539511:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539516:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539521:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460726.539524:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539530:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539537:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9650c52ed500) 00010000:00010000:3.0:1788460726.539539:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460726.539542:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539548:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8ef1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539599:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8ee3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18f3 expref: 11 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539609:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460726.539611:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460726.539615:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8ee3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18f3 expref: 11 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.539624:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4200, rc 0) 00000100:00100000:3.0:1788460726.539687:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+10:17423:x1875336462743680:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 837us (1836us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788460726.539694:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 25 00000100:00100000:1.0:1788460726.544739:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460726.544830:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462743808 00000100:00100000:3.0:1788460726.544840:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462743808 00000100:00100000:3.0:1788460726.544902:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:3.0:1788460726.544912:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+10:17423:x1875336462743808:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460726.544954:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460726.544986:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8eff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d18fa expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545086:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545100:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545111:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460726.545310:0:19034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788460726.545315:0:19034:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460726.545333:0:19034:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545358:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8eff lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 12 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545482:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460726.545492:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:3.0:1788460726.545495:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460726.545498:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5600, rc 0) 00000100:00100000:3.0:1788460726.545555:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+11:17423:x1875336462743808:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 644us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460726.545562:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:0.0:1788460726.557484:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.557993:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462743936 00000100:00100000:1.0:1788460726.558006:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462743936 00000100:00100000:1.0:1788460726.558070:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:1.0:1788460726.558095:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+11:17423:x1875336462743936:12345-192.168.203.32@tcp:37:lfs.0 00000100:00100000:1.0:1788460726.566158:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+11:17423:x1875336462743936:12345-192.168.203.32@tcp:37:lfs.0 Request processed in 8054us (8682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460726.566171:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:3.0:1788460726.578275:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460726.578591:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462744192 00000100:00100000:0.0:1788460726.578602:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462744192 00000100:00100000:0.0:1788460726.578662:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1788460726.578672:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e6df1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+11:17423:x1875336462744192:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:1.0:1788460726.580287:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e6df1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+12:17423:x1875336462744192:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 1607us (2012us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788460726.580299:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00010000:00010000:0.0:1788460726.668531:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460726.697343:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.697671:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462744320 00000100:00100000:2.0:1788460726.697682:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462744320 00000100:00100000:2.0:1788460726.697846:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:2.0:1788460726.697858:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+10:17429:x1875336462744320:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460726.697887:0:19036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.697920:0:19036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8f0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1901 expref: -99 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.697984:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.697997:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698008:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698022:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698039:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698045:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698131:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8f22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698141:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8f22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698148:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8f22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460726.698243:0:19036:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788460726.698247:0:19036:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460726.698328:0:19036:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8f22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698348:0:19036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698369:0:19036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698854:0:19036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698863:0:19036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.698867:0:19036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698885:0:19036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698898:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460726.698901:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.698905:0:19036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698911:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698927:0:19036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698934:0:19036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698939:0:19036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698951:0:19036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460726.698955:0:19036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698961:0:19036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698969:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9650c34d0700) 00010000:00010000:2.0:1788460726.698972:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460726.698975:0:19036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.698981:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8f1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.699018:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b8f0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1901 expref: 12 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.699058:0:19036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54a00/0x889bb893541b8f22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1901 expref: 11 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.699066:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:2.0:1788460726.699068:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460726.699071:0:19036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54a00, rc 0) 00000100:00100000:2.0:1788460726.699159:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+11:17429:x1875336462744320:12345-192.168.203.32@tcp:101:bash.0 Request processed in 1303us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.699169:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:1.0:1788460726.708345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.708654:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462744576 00000100:00100000:2.0:1788460726.708674:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462744576 00000100:00100000:2.0:1788460726.708791:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 28 00000100:00100000:2.0:1788460726.708802:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+11:17429:x1875336462744576:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460726.708821:0:21022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460726.708839:0:21022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b8f29 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1908 expref: -99 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.708954:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.708968:0:21022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.708976:0:21022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.709009:0:21022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460726.709023:0:21022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 11 pid: 19034 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460726.709037:0:21022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482664320:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460726.709368:0:21022:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3333540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460726.733936:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.734238:0:21022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5005180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482664320:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460726.734267:0:21022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460726.734718:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462744704 00000100:00100000:0.0:1788460726.734725:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462744704 00010000:00010000:0.0:1788460726.734762:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 12 pid: 19034 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460726.734803:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460726.734813:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e89c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+12:2380:x1875336462744704:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460726.734827:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460726.734833:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 12 pid: 19034 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734846:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 12 pid: 19034 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734867:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b8f06 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d18fa expref: 12 pid: 19034 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734880:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:0.0:1788460726.734885:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734902:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734910:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.734947:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460726.735046:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e89c0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+11:2380:x1875336462744704:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 234us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460726.735062:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00010000:00010000:1.0:1788460726.735216:0:21022:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735224:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735295:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735308:0:21022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735316:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735922:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735932:0:21022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735949:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460726.735962:0:21022:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788460726.735987:0:21022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.735995:0:21022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736002:0:21022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736008:0:21022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460726.736012:0:21022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736019:0:21022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736028:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:1.0:1788460726.736032:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460726.736036:0:21022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736041:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b8f30 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460726.736064:0:21022:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001047b65e reply state 0000000067820460 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460726.736083:0:21022:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788460726.736468:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b8f29 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 14 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736619:0:21022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 13 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.736628:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:1.0:1788460726.736631:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788460726.736633:0:21022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d600, rc 0) 00000100:00100000:1.0:1788460726.736682:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17429:x1875336462744576:12345-192.168.203.32@tcp:101:bash.0 Request processed in 27883us (28347us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788460726.736690:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 28 00010000:00010000:0.0:1788460726.755148:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755166:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755173:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755201:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460726.755206:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755214:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755229:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9650e70d8100) 00010000:00010000:0.0:1788460726.755231:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460726.755236:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.755258:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8f37 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460726.787625:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.787819:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462744832 00000100:00100000:1.0:1788460726.787829:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462744832 00000100:00100000:1.0:1788460726.787898:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:1.0:1788460726.787907:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+13:17429:x1875336462744832:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:1.0:1788460726.787929:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460726.787947:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8f4c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d190f expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788005:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788019:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788048:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460726.788090:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788460726.788094:0:19035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460726.788112:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788122:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788147:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8f4c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d190f expref: 15 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788165:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d190f expref: 14 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.788174:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:1.0:1788460726.788220:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460726.788224:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029ca00, rc 0) 00000100:00100000:1.0:1788460726.788297:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17429:x1875336462744832:12345-192.168.203.32@tcp:101:bash.0 Request processed in 390us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460726.788305:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 29 00000100:00100000:2.0:1788460726.796617:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460726.796638:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482664576:0@lo:400:kworker.0 00000100:00100000:0.0:1788460726.796686:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482664832:0@lo:400:kworker.0 00000100:00100000:2.0:1788460726.796709:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460726.796712:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460726.796776:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482664960:0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.799060:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482664704:0@lo:400:kworker.0 00000100:00100000:1.0:1788460726.800316:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460726.800355:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460726.800367:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482665088:0@lo:400:kworker.0 00000100:00100000:1.0:1788460726.800398:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460726.800591:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460726.800592:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482664448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460726.800621:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462745088 00000100:00100000:2.0:1788460726.800630:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460726.800630:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462745088 00000100:00100000:0.0:1788460726.800648:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664960 00000100:00100000:0.0:1788460726.800654:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664960 00000100:00100000:2.0:1788460726.800667:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664576 00000100:00100000:2.0:1788460726.800670:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664576 00000100:00100000:0.0:1788460726.800690:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482665088 00000100:00100000:0.0:1788460726.800693:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482665088 00000100:00100000:2.0:1788460726.800695:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788460726.800703:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:3319:x1875336482664576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460726.800717:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460726.800722:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482664960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460726.800751:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:13026af2-46ad-415c-9f59-ba32734436e0+23:3319:x1875336482664576:12345-0@lo:400:kworker.0 Request processed in 49us (4041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460726.800752:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875336482664960:12345-0@lo:400:kworker.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.800759:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788460726.800759:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460726.800773:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460726.800778:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482665088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460726.800802:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875336482665088:12345-0@lo:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.800807:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664448 00000100:00100000:0.0:1788460726.800808:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460726.800810:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664448 00000100:00080000:0.0:1788460726.800822:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460726.800826:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460726.800834:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460726.800850:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3318:1875336482665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788460726.800864:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875336482664960:0@lo:400:kworker.0 00000100:00100000:1.0:1788460726.800908:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:1.0:1788460726.800915:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17429:x1875336462745088:12345-192.168.203.32@tcp:35:bash.0 00000100:00100000:1.0:1788460726.801481:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17429:x1875336462745088:12345-192.168.203.32@tcp:35:bash.0 Request processed in 565us (892us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788460726.801490:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 5 00000100:00100000:2.0:1788460726.802070:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482664448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460726.802106:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788460726.802157:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875336482664448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1316us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.802166:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460726.802229:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664832 00000100:00100000:2.0:1788460726.802235:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664832 00000100:00100000:2.0:1788460726.802333:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460726.802344:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482664832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460726.802420:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1875336482664832:12345-0@lo:400:kworker.0 Request processed in 79us (5706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460726.802437:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460726.802494:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:13026af2-46ad-415c-9f59-ba32734436e0:3319:1875336482664576:0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.802527:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460726.802536:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3319:1875336482664448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460726.807255:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482664704 00000100:00100000:0.0:1788460726.807286:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482664704 00000100:00100000:0.0:1788460726.807360:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460726.807370:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482664704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460726.807453:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482664704:12345-0@lo:400:kworker.0 Request processed in 85us (4927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460726.807461:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788460726.807486:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460726.808812:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482664704:0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.808827:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482665216:0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.808872:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460726.808986:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482665216 00000100:00100000:3.0:1788460726.808992:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482665216 00000100:00100000:3.0:1788460726.809038:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788460726.809056:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482665216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.809097:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482665216:12345-0@lo:400:kworker.0 Request processed in 42us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460726.809103:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788460726.809119:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460726.809135:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482665216:0@lo:400:kworker.0 00000100:00100000:3.0:1788460726.809170:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3317:1875336482664832:0@lo:400:kworker.0 00000100:00100000:2.0:1788460726.923295:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460726.923368:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462745344 00000100:00100000:0.0:1788460726.923376:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462745344 00000100:00100000:0.0:1788460726.923431:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:0.0:1788460726.923442:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17439:x1875336462745344:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:0.0:1788460726.923466:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460726.923733:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5200/0x889bb893541b8f5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1916 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460726.923939:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788460726.924129:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5200/0x889bb893541b8f5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1916 expref: 17 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.924143:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:0.0:1788460726.924147:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460726.924152:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5200/0x889bb893541b8f5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1916 expref: 17 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460726.924166:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5200, rc 0) 00000100:00100000:2.0:1788460726.926226:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17439:x1875336462745344:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 2777us (2928us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788460726.926243:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 30 00000100:00100000:0.0:1788460726.932435:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.932691:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462745600 00000100:00100000:1.0:1788460726.932702:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462745600 00000100:00100000:2.0:1788460726.932878:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:2.0:1788460726.932890:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17439:x1875336462745600:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460726.933335:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+17:17439:x1875336462745600:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 446us (908us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788460726.933342:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 6 00000100:00100000:3.0:1788460726.988278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460726.988396:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462745856 00000100:00100000:1.0:1788460726.988405:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462745856 00000100:00100000:1.0:1788460726.988463:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:1.0:1788460726.988473:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+17:17442:x1875336462745856:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:1.0:1788460726.988507:0:19036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460726.988527:0:19036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8f68 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d191d expref: -99 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.988629:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8f6f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.988643:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8f6f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.988664:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8f6f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460726.988693:0:19036:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788460726.988813:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d200/0x889bb893541b8f68 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d191d expref: 20 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.988832:0:19036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8f6f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d191d expref: 19 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460726.988841:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:1.0:1788460726.988844:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460726.988848:0:19036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029c200, rc 0) 00000100:00100000:1.0:1788460726.988909:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:17442:x1875336462745856:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 437us (641us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1788460726.988915:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 31 00000100:00100000:3.0:1788460727.000533:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460727.000651:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462745984 00000100:00100000:0.0:1788460727.000661:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462745984 00000100:00100000:0.0:1788460727.000737:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1788460727.000748:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:17442:x1875336462745984:12345-192.168.203.32@tcp:54:lfs.0 00010000:00010000:0.0:1788460727.000818:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000835:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000847:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000873:0:19034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000881:0:19034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000889:0:19034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000895:0:19034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff964fc1ea5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460727.000900:0:19034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000909:0:19034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000920:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460727.000935:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460727.000940:0:19034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.000958:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5000/0x889bb893541b8f7d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460727.001032:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:17442:x1875336462745984:12345-192.168.203.32@tcp:54:lfs.0 Request processed in 286us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.001039:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 32 00000100:00100000:0.0:1788460727.004756:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460727.005576:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746240 00000100:00100000:2.0:1788460727.005591:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746240 00000100:00100000:2.0:1788460727.005678:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:2.0:1788460727.005690:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:17442:x1875336462746240:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460727.005935:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+20:17442:x1875336462746240:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 247us (1189us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788460727.005943:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 7 00000100:00100000:3.0:1788460727.007565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460727.008347:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746368 00000100:00100000:0.0:1788460727.008356:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746368 00000100:00100000:0.0:1788460727.008431:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:0.0:1788460727.008441:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+20:2379:x1875336462746368:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460727.008455:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460727.008479:0:19021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8f6f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d191d expref: 20 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.008508:0:19021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460727.008513:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460727.008578:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:2379:x1875336462746368:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 132us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.008586:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 1 00000100:00100000:3.0:1788460727.031416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.031455:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.031495:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.031534:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.031556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460727.031641:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746624 00000100:00100000:0.0:1788460727.031652:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746624 00000100:00100000:0.0:1788460727.031733:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746752 00000100:00100000:0.0:1788460727.031737:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746752 00000100:00100000:0.0:1788460727.031751:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746880 00000100:00100000:0.0:1788460727.031753:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746880 00000100:00100000:0.0:1788460727.031765:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462747008 00000100:00100000:0.0:1788460727.031782:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462747008 00000100:00100000:0.0:1788460727.031803:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460727.031811:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2379:x1875336462746624:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460727.031892:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2379:x1875336462746624:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 80us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.031907:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460727.031922:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460727.031929:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2380:x1875336462746752:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460727.031953:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2380:x1875336462746752:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.031973:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:0.0:1788460727.031985:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460727.031991:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462746880:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460727.032013:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462746880:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 23us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.032019:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:0.0:1788460727.032029:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:0.0:1788460727.032034:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2380:x1875336462747008:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460727.032063:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2380:x1875336462747008:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.032068:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1788460727.032356:0:19028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462746496 00000100:00100000:2.0:1788460727.032361:0:19028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462746496 00000100:00100000:2.0:1788460727.032389:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00100000:2.0:1788460727.032397:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:2380:x1875336462746496:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460727.032431:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:33947916-367f-49ef-b7e1-278b016d1427+14:2380:x1875336462746496:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 35us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460727.032438:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 140 00000100:00080000:3.0:1788460727.032827:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460727.032832:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788460727.244996:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460727.307127:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460727.307289:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462747264 00000100:00100000:2.0:1788460727.307301:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462747264 00000100:00100000:2.0:1788460727.307363:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1788460727.307383:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+19:17473:x1875336462747264:12345-192.168.203.32@tcp:101:cat.0 00010000:00010000:2.0:1788460727.307412:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460727.307433:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f84 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1924 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.307550:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8f8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.307567:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8f8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.307580:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8f8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460727.307591:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460727.307746:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8f84 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1924 expref: 22 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.307770:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8f8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1924 expref: 21 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.307779:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460727.307782:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460727.307786:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54e00, rc 0) 00000100:00100000:2.0:1788460727.307853:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+21:17473:x1875336462747264:12345-192.168.203.32@tcp:101:cat.0 Request processed in 481us (736us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788460727.307881:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 33 00000100:00100000:2.0:1788460727.318171:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460727.318248:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460727.318346:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462747648 00000100:00100000:0.0:1788460727.318356:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462747648 00000100:00100000:0.0:1788460727.318450:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:0.0:1788460727.318461:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+21:2380:x1875336462747648:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460727.318476:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460727.318508:0:19020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8f8b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1924 expref: 21 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.318529:0:19020:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460727.318535:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460727.318594:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+20:2380:x1875336462747648:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460727.318602:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 2 00000100:00100000:1.0:1788460727.319441:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462747520 00000100:00100000:1.0:1788460727.319450:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462747520 00000100:00100000:1.0:1788460727.319491:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:1.0:1788460727.319507:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+20:17473:x1875336462747520:12345-192.168.203.32@tcp:35:cat.0 00000100:00100000:1.0:1788460727.319810:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+21:17473:x1875336462747520:12345-192.168.203.32@tcp:35:cat.0 Request processed in 311us (1647us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788460727.319818:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 8 00000100:00100000:2.0:1788460727.451077:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.451297:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462747904 00000100:00100000:3.0:1788460727.451306:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462747904 00000100:00100000:3.0:1788460727.451376:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:3.0:1788460727.451388:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+21:17479:x1875336462747904:12345-192.168.203.32@tcp:101:dd.0 00010000:00010000:3.0:1788460727.451413:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460727.451432:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8f99 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d192b expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.451551:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8fa0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.451580:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8fa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.451592:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8fa0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460727.451605:0:20910:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788460727.451759:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8f99 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d192b expref: 24 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.451780:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8fa0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d192b expref: 23 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.451787:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:3.0:1788460727.451790:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460727.451793:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4200, rc 0) 00000100:00100000:3.0:1788460727.451871:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17479:x1875336462747904:12345-192.168.203.32@tcp:101:dd.0 Request processed in 485us (804us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788460727.451879:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 34 00000100:00100000:0.0:1788460727.457940:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460727.458086:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462748032 00000100:00100000:2.0:1788460727.458098:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462748032 00000100:00100000:2.0:1788460727.458170:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460727.458210:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:2381:x1875336462748032:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460727.458225:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460727.458249:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b8fa0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d192b expref: 23 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460727.458268:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460727.458273:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460727.458334:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+22:2381:x1875336462748032:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 155us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460727.458342:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 3 00000100:00100000:2.0:1788460727.459412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460727.459555:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462748288 00000100:00100000:3.0:1788460727.459562:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462748288 00000100:00100000:3.0:1788460727.459610:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 35 00000100:00100000:3.0:1788460727.459618:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+22:17479:x1875336462748288:12345-192.168.203.32@tcp:36:dd.0 00010000:00010000:3.0:1788460727.459667:0:21022:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460727.459686:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029ca00/0x889bb893541b8f53 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d190f expref: 22 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.459713:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:3.0:1788460727.459717:0:21022:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460727.459944:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.459957:0:21022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460727.459968:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460727.460630:0:21022:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788460727.460663:0:21022:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a98f1f4b reply state 000000009a799feb transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460727.460672:0:21022:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460727.460771:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5005500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:17479:x1875336462748288:12345-192.168.203.32@tcp:36:dd.0 Request processed in 1151us (1362us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788460727.460779:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 35 00000020:00080000:3.0:1788460727.460784:0:21022:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460727.463088:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463105:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463112:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463118:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460727.463123:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463130:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463145:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460727.463148:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460727.463168:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460727.463175:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b8fae lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460727.582599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460727.582851:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462748544 00000100:00100000:1.0:1788460727.582862:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462748544 00000100:00100000:1.0:1788460727.582967:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 9 00000100:00100000:1.0:1788460727.582978:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17479:x1875336462748544:12345-192.168.203.32@tcp:35:dd.0 00000100:00100000:1.0:1788460727.583343:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:17479:x1875336462748544:12345-192.168.203.32@tcp:35:dd.0 Request processed in 366us (753us total) trans 12884901907 rc 0/0 00000100:00100000:1.0:1788460727.583366:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 9 00010000:00010000:2.0:1788460727.693336:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460727.895714:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460727.895833:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462748672 00000100:00100000:1.0:1788460727.895843:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462748672 00000100:00100000:1.0:1788460727.895914:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:1.0:1788460727.895924:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:17493:x1875336462748672:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:1.0:1788460727.895949:0:19036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460727.895970:0:19036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8fb5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1932 expref: -99 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896049:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896064:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896078:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896093:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896100:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896106:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896242:0:19036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896269:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896276:0:19036:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460727.896310:0:19036:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788460727.896314:0:19036:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788460727.896355:0:19036:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896366:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896376:0:19036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896381:0:19036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896388:0:19036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896394:0:19036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029cc00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460727.896398:0:19036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896405:0:19036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896417:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:1.0:1788460727.896426:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460727.896431:0:19036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896438:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029cc00/0x889bb893541b8fbc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896452:0:19036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896458:0:19036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896463:0:19036:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896468:0:19036:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029da00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460727.896471:0:19036:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896477:0:19036:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896484:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9650e70d8e00) 00010000:00010000:1.0:1788460727.896487:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460727.896490:0:19036:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896505:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029da00/0x889bb893541b8fc3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19036 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896538:0:19036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c200/0x889bb893541b8fb5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1932 expref: 26 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896564:0:19036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1932 expref: 25 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460727.896571:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:1.0:1788460727.896573:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460727.896576:0:19036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d800, rc 0) 00000100:00100000:1.0:1788460727.896638:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+25:17493:x1875336462748672:12345-192.168.203.32@tcp:101:stat.0 Request processed in 715us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460727.896647:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 36 00000100:00100000:0.0:1788460728.029289:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460728.029424:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462748928 00000100:00100000:3.0:1788460728.029434:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462748928 00000100:00100000:3.0:1788460728.029521:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 37 00000100:00100000:3.0:1788460728.029534:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+25:17499:x1875336462748928:12345-192.168.203.32@tcp:36:truncate.0 00010000:00010000:3.0:1788460728.029587:0:19034:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460728.029615:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d800/0x889bb893541b8fca lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1932 expref: 25 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.029653:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:3.0:1788460728.029657:0:19034:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460728.029871:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.029885:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.029895:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460728.029946:0:19034:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788460728.029970:0:19034:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a03bd7f4 reply state 00000000584d27c6 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.029979:0:19034:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460728.030103:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+27:17499:x1875336462748928:12345-192.168.203.32@tcp:36:truncate.0 Request processed in 571us (822us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788460728.030112:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 37 00000020:00080000:3.0:1788460728.030116:0:19034:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788460728.030644:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460728.035316:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035334:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035341:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035348:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460728.035357:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035366:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035381:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460728.035384:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460728.035388:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.035395:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b8fd1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460728.217675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.217874:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462749056 00000100:00100000:2.0:1788460728.217887:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462749056 00000100:00100000:2.0:1788460728.217958:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1788460728.217970:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+26:17513:x1875336462749056:12345-192.168.203.32@tcp:101:stat.0 00010000:00010000:2.0:1788460728.217993:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460728.218012:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b8fd8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1939 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218085:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218100:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218111:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218124:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218130:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218136:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218258:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218267:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218273:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460728.218306:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788460728.218310:0:19035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460728.218331:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218352:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218360:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218367:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218374:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218380:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460728.218384:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218392:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218403:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:2.0:1788460728.218411:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460728.218416:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218423:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b8fdf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218436:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218441:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218452:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218457:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460728.218460:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218467:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218474:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9650c34d0700) 00010000:00010000:2.0:1788460728.218477:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460728.218479:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218486:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b8fe6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218527:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b8fd8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 28 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218541:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 27 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.218548:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460728.218550:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460728.218552:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d54000, rc 0) 00000100:00100000:2.0:1788460728.219122:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+27:17513:x1875336462749056:12345-192.168.203.32@tcp:101:stat.0 Request processed in 1152us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460728.219144:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 38 00000100:00100000:2.0:1788460728.354982:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460728.355109:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462749312 00000100:00100000:3.0:1788460728.355120:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462749312 00000100:00100000:3.0:1788460728.355229:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:3.0:1788460728.355240:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+27:17523:x1875336462749312:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:3.0:1788460728.355260:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460728.355279:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1940 expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460728.355391:0:20910:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788460728.355507:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8ff4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1940 expref: 29 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.355520:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:3.0:1788460728.355523:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460728.355528:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b8ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1940 expref: 29 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.355542:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5000, rc 0) 00000100:00100000:3.0:1788460728.355590:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+28:17523:x1875336462749312:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 351us (617us total) trans 12884901910 rc 301/301 00000100:00100000:3.0:1788460728.355597:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 39 00000100:00100000:0.0:1788460728.359659:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.359859:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462749568 00000100:00100000:2.0:1788460728.359881:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462749568 00000100:00100000:2.0:1788460728.359931:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:2.0:1788460728.359941:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e6df3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+28:17523:x1875336462749568:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460728.360574:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e6df3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+29:17523:x1875336462749568:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 216us (508us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788460728.360583:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 10 00000100:00100000:1.0:1788460728.510659:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460728.510861:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462749824 00000100:00100000:3.0:1788460728.510886:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462749824 00000100:00100000:3.0:1788460728.510944:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1788460728.510953:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+29:17528:x1875336462749824:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:3.0:1788460728.510976:0:21022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460728.510996:0:21022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9002 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1947 expref: -99 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511113:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511128:0:21022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511447:0:21022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 30 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511457:0:21022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511498:0:21022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 30 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511521:0:21022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 30 pid: 19035 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.511535:0:21022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665344:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460728.511646:0:21022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.511655:0:21022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.511665:0:21022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650f5e7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665472:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460728.511688:0:21022:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650d3325780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460728.531008:0:21022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665344:192.168.203.32@tcp:104: 00000100:00100000:1.0:1788460728.531024:0:21022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650f5e7e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665472:192.168.203.32@tcp:104: 00010000:00010000:1.0:1788460728.531049:0:21022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460728.536147:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460728.536276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.536410:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462749952 00000100:00100000:2.0:1788460728.536420:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462749952 00010000:00010000:2.0:1788460728.536460:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 31 pid: 19035 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460728.536505:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750080 00000100:00100000:2.0:1788460728.536509:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750080 00010000:00010000:2.0:1788460728.536522:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 32 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460728.536538:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460728.536547:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:2380:x1875336462749952:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460728.536559:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460728.536564:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 32 pid: 19035 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536577:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 32 pid: 19035 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536611:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b8fed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1939 expref: 32 pid: 19035 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536627:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460728.536632:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536640:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536647:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460728.536698:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:2380:x1875336462749952:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 152us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460728.536705:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:2.0:1788460728.536722:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:2.0:1788460728.536728:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+30:2380:x1875336462750080:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460728.536735:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460728.536740:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536749:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536767:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029d600/0x889bb893541b8f3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1908 expref: 30 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536788:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460728.536792:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536798:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536805:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536828:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460728.536848:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+29:2380:x1875336462750080:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 121us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460728.536854:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00010000:00010000:2.0:1788460728.536888:0:21022:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.536895:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460728.536911:0:21022:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788460728.537047:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9002 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 30 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.537060:0:21022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 29 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.537067:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460728.537074:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460728.537077:0:21022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5000, rc 0) 00000100:00100000:2.0:1788460728.537100:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+29:17528:x1875336462749824:12345-192.168.203.32@tcp:101:bash.0 Request processed in 26149us (26451us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788460728.537106:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 40 00000100:00100000:3.0:1788460728.539676:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.539877:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750336 00000100:00100000:2.0:1788460728.539886:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750336 00000100:00100000:2.0:1788460728.539940:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 41 00000100:00100000:2.0:1788460728.539949:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+29:17528:x1875336462750336:12345-192.168.203.32@tcp:36:bash.0 00010000:00010000:2.0:1788460728.540228:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.540245:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.540255:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460728.540306:0:19035:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:2.0:1788460728.540330:0:19035:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005778659e reply state 00000000d9bc54d8 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460728.540337:0:19035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460728.540421:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17528:x1875336462750336:12345-192.168.203.32@tcp:36:bash.0 Request processed in 472us (752us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788460728.540428:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 41 00000020:00080000:2.0:1788460728.540432:0:19035:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460728.543263:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543281:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543289:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543296:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55800 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460728.543301:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543309:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543326:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460728.543328:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460728.543333:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.543340:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55800/0x889bb893541b9017 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.546243:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460728.546709:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750464 00000100:00100000:0.0:1788460728.546719:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750464 00000100:00100000:0.0:1788460728.546776:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:0.0:1788460728.546786:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17528:x1875336462750464:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460728.546824:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460728.546842:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b901e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d194e expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.547049:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b901e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d194e expref: 32 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.547063:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b901e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d194e expref: 32 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.547079:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460728.547081:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460728.547084:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5400, rc 0) 00000100:00100000:0.0:1788460728.547138:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17528:x1875336462750464:12345-192.168.203.32@tcp:101:bash.0 Request processed in 355us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460728.547144:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 42 00000100:00100000:1.0:1788460728.554435:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.554587:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750592 00000100:00100000:2.0:1788460728.554597:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750592 00000100:00100000:2.0:1788460728.554655:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:2.0:1788460728.554678:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17528:x1875336462750592:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:2.0:1788460728.554700:0:21022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460728.554719:0:21022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9025 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1955 expref: -99 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.554827:0:21022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.554842:0:21022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 33 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.554851:0:21022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.554894:0:21022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 33 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.554909:0:21022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 33 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460728.554922:0:21022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665600:192.168.203.32@tcp:104: 00000100:00100000:2.0:1788460728.555005:0:21022:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c75fa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460728.563840:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460728.564037:0:21022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c5004a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:21022:1875336482665600:192.168.203.32@tcp:104: 00010000:00010000:2.0:1788460728.564067:0:21022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.564312:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750720 00000100:00100000:3.0:1788460728.564319:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750720 00010000:00010000:3.0:1788460728.564353:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 34 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460728.564521:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:3.0:1788460728.564530:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+34:2379:x1875336462750720:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460728.564688:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460728.564695:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 34 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564707:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 34 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564727:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9009 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1947 expref: 34 pid: 21022 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564742:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:3.0:1788460728.564746:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564764:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564771:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.564796:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460728.564843:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+33:2379:x1875336462750720:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 314us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460728.564850:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:2.0:1788460728.564965:0:21022:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.564983:0:21022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460728.565025:0:21022:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788460728.565029:0:21022:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788460728.565048:0:21022:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21022 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.565076:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9025 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1955 expref: 33 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.565089:0:21022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1955 expref: 32 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460728.565096:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:2.0:1788460728.565098:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460728.565101:0:21022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55c00, rc 0) 00000100:00100000:2.0:1788460728.565125:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17528:x1875336462750592:12345-192.168.203.32@tcp:101:bash.0 Request processed in 10450us (10701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460728.565131:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 43 00000100:00100000:3.0:1788460728.574329:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460728.574549:0:19021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462750976 00000100:00100000:0.0:1788460728.574560:0:19021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462750976 00000100:00100000:0.0:1788460728.574625:0:19021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:0.0:1788460728.574634:0:19021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650e89c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17528:x1875336462750976:12345-192.168.203.32@tcp:103:bash.0 00010000:00010000:0.0:1788460728.574649:0:19021:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788460728.574673:0:19021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b902c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1955 expref: 32 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.574696:0:19021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b901e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d194e expref: 31 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.574718:0:19021:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650e70d8f00) 00010000:00010000:0.0:1788460728.574730:0:19021:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460728.574796:0:19021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650e89c3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+30:17528:x1875336462750976:12345-192.168.203.32@tcp:103:bash.0 Request processed in 162us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460728.574804:0:19021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 4 00000100:00100000:1.0:1788460728.577234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460728.577461:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751104 00000100:00100000:3.0:1788460728.577471:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751104 00000100:00100000:3.0:1788460728.577542:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:3.0:1788460728.577552:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+30:17528:x1875336462751104:12345-192.168.203.32@tcp:58:bash.0 00010000:00010000:3.0:1788460728.577643:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.577660:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460728.577672:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460728.581125:0:20910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460728.586002:0:20910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788460728.586089:0:20910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788460728.586239:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+30:17528:x1875336462751104:12345-192.168.203.32@tcp:58:bash.0 Request processed in 8683us (9008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460728.586252:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 44 00000100:00100000:1.0:1788460728.594720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460728.594815:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751232 00000100:00100000:0.0:1788460728.594824:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751232 00000100:00100000:0.0:1788460728.594880:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 45 00000100:00100000:0.0:1788460728.594890:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+30:17528:x1875336462751232:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460728.594909:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460728.594929:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d195c expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.594981:0:19034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.594991:0:19034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 31 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.595009:0:19034:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.595023:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 31 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.595035:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:0.0:1788460728.595050:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460728.595055:0:19034:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 31 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460728.595065:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5400, rc 0) 00000100:00100000:0.0:1788460728.595128:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17528:x1875336462751232:12345-192.168.203.32@tcp:101:bash.0 Request processed in 240us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460728.595135:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 45 00010000:00010000:2.0:1788460728.717140:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460728.844566:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460728.844588:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fded1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482665728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460728.844674:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460728.845005:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482665728 00000100:00100000:1.0:1788460728.845014:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482665728 00000100:00100000:1.0:1788460728.845081:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460728.845091:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482665728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460728.845126:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788460728.845203:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482665728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460728.845218:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460728.845318:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fded1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482665728:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788460728.845448:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788460729.292417:0:19069:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788460729.292428:0:19069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460729.292492:0:19069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788460729.292498:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788460729.292622:0:19069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19069:1875336482665856:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460729.292739:0:19069:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650e6c56d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460729.302102:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.302220:0:19045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751360 00000100:00100000:3.0:1788460729.302229:0:19045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751360 00000100:00100000:3.0:1788460729.302278:0:19045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460729.302287:0:19045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462751360:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788460729.302364:0:19045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fded1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462751360:12345-192.168.203.32@tcp:900:lhsmtool_posix.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.302372:0:19045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 0 00000100:00100000:3.0:1788460729.307013:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.307154:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751488 00000100:00100000:2.0:1788460729.307164:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751488 00000100:00100000:2.0:1788460729.307249:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1788460729.307259:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462751488:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460729.307291:0:21022:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788460729.307381:0:19069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650d831e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19069:1875336482665856:192.168.203.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788460729.307413:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17530:x1875336462751488:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 156us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460729.307420:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 46 00000100:00100000:2.0:1788460729.324128:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.325227:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751616 00000100:00100000:3.0:1788460729.325242:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751616 00000100:00100000:3.0:1788460729.325305:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:3.0:1788460729.325316:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17530:x1875336462751616:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.325661:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325697:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325711:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325786:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325794:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325802:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325829:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325836:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.325843:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460729.325885:0:20910:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788460729.325889:0:20910:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460729.327094:0:20910:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327123:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327150:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327158:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327164:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460729.327169:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327193:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327210:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:3.0:1788460729.327213:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460729.327219:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327226:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9041 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327243:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327249:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327254:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327260:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460729.327269:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327277:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327285:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9650c52ed500) 00010000:00010000:3.0:1788460729.327288:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460729.327291:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327298:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9048 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327317:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327323:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327329:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327334:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460729.327337:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327342:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327350:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:3.0:1788460729.327352:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460729.327977:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.327986:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b904f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.328282:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5006680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17530:x1875336462751616:12345-192.168.203.32@tcp:34:lhsmtool_posix.0 Request processed in 2962us (4158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.328294:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 47 00000100:00100000:1.0:1788460729.347767:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.347888:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462751872 00000100:00100000:2.0:1788460729.347914:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462751872 00000100:00100000:2.0:1788460729.347977:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1788460729.347988:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+31:17530:x1875336462751872:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460729.348008:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460729.348038:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b9056 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1963 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.348136:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.348961:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.348979:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460729.349028:0:19035:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460729.349134:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349142:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349148:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349240:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.349244:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349252:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349265:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:2.0:1788460729.349268:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460729.349272:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349277:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b905d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349325:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b9056 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1963 expref: 33 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349336:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9650e70d8a00) 00010000:00010000:2.0:1788460729.349339:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460729.349349:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55000/0x889bb893541b9056 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1963 expref: 33 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.349574:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55000, rc 0) 00000100:00100000:2.0:1788460729.349746:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462751872:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 1759us (1990us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1788460729.349755:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 48 00000100:00100000:2.0:1788460729.377814:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.378198:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462752000 00000100:00100000:0.0:1788460729.378208:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462752000 00000100:00100000:0.0:1788460729.378258:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:0.0:1788460729.378268:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462752000:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788460729.378304:0:19036:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788460729.378404:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c5007100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462752000:12345-192.168.203.32@tcp:53:lhsmtool_posix.0 Request processed in 136us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460729.378411:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 49 00000100:00100000:3.0:1788460729.407310:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.407345:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462752256 00000100:00100000:3.0:1788460729.407360:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462752256 00000100:00100000:3.0:1788460729.407413:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:3.0:1788460729.407423:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+32:17530:x1875336462752256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.407444:0:20910:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460729.407476:0:20910:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b906b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d196a expref: -99 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460729.412655:0:20910:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:3.0:1788460729.412670:0:20910:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:3.0:1788460729.412736:0:20910:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:3.0:1788460729.414353:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9072 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.414379:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9072 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.414390:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9072 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.414533:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b906b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d196a expref: 35 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.414564:0:20910:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9072 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d196a expref: 34 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.414573:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:3.0:1788460729.414576:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460729.414579:0:20910:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5400, rc 0) 00000100:00100000:3.0:1788460729.414639:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+34:17530:x1875336462752256:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 7218us (7338us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1788460729.414648:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 50 00000100:00100000:1.0:1788460729.420608:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.424709:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462752512 00000100:00100000:3.0:1788460729.424725:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462752512 00000100:00100000:3.0:1788460729.424795:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:3.0:1788460729.424806:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+34:17530:x1875336462752512:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.424865:0:19035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460729.424890:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5400/0x889bb893541b9072 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d196a expref: 34 pid: 20910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.424917:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c52edf00) 00010000:00010000:3.0:1788460729.424928:0:19035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460729.424949:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.424963:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.424972:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425055:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425064:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425070:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425297:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425305:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425312:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425319:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460729.425323:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425331:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425340:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:3.0:1788460729.425344:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460729.425347:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425354:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b9080 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425382:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425388:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425393:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425398:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:3.0:1788460729.425401:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425408:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425416:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd0994719 (ffff9650c52ed500) 00010000:00010000:3.0:1788460729.425419:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460729.425421:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.425427:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b9087 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd0994719 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.425646:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+33:17530:x1875336462752512:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 840us (5045us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460729.425655:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 51 00000100:00100000:2.0:1788460729.428500:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.429374:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462752640 00000100:00100000:0.0:1788460729.429386:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462752640 00000100:00100000:0.0:1788460729.429437:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:0.0:1788460729.429471:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+33:17530:x1875336462752640:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460729.429502:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460729.429524:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b908e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1971 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429561:0:19034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b9095 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429575:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b9095 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429586:0:19034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b9095 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429679:0:19034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4800/0x889bb893541b908e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1971 expref: 35 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429697:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea4400/0x889bb893541b9095 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1971 expref: 34 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.429706:0:19034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:0.0:1788460729.429709:0:19034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460729.429712:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea4400, rc 0) 00000100:00100000:0.0:1788460729.429778:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+34:17530:x1875336462752640:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 309us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460729.429785:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 52 00000100:00100000:3.0:1788460729.432345:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460729.432439:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462752896 00000100:00100000:1.0:1788460729.432449:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462752896 00000100:00100000:1.0:1788460729.432518:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 53 00000100:00100000:1.0:1788460729.432529:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+34:17530:x1875336462752896:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460729.432606:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.432623:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.432634:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460729.433116:0:20910:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1788460729.433128:0:20910:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 602668948305ns, next at 603668945805ns, rc = 0 00000004:00010000:1.0:1788460729.433245:0:20910:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000493ea95b reply state 000000004cf153c6 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460729.433254:0:20910:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460729.433331:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+36:17530:x1875336462752896:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 804us (994us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788460729.433339:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 53 00000001:00080000:3.0:1788460729.434740:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901898 is committed 00000001:00080000:3.0:1788460729.434761:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788460729.434766:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901907 is committed 00000001:00080000:3.0:1788460729.434780:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901915 is committed 00010000:00010000:2.0:1788460729.437031:0:3302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437052:0:3302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437060:0:3302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437068:0:3302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029de00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.437073:0:3302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437080:0:3302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437096:0:3302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:2.0:1788460729.437099:0:3302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460729.437104:0:3302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.437109:0:3302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029de00/0x889bb893541b909c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.441560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.441715:0:19036:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753024 00000100:00100000:2.0:1788460729.441725:0:19036:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753024 00000100:00100000:2.0:1788460729.441790:0:19036:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460729.441800:0:19036:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+13:17530:x1875336462753024:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460729.441824:0:19036:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460729.441844:0:19036:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1978 expref: -99 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.441907:0:19036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 14 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.441922:0:19036:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 14 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.441942:0:19036:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:2.0:1788460729.441945:0:19036:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460729.441949:0:19036:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55400, rc 0) 00000100:00100000:2.0:1788460729.442013:0:19036:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17530:x1875336462753024:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 214us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460729.442020:0:19036:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 54 00000100:00100000:2.0:1788460729.447174:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.448254:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753152 00000100:00100000:0.0:1788460729.448265:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753152 00000100:00100000:1.0:1788460729.448618:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460729.448632:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2379:x1875336462753152:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788460729.449002:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2379:x1875336462753152:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 373us (1837us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788460729.449108:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00080000:0.0:1788460729.449390:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460729.453561:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.454643:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753408 00000100:00100000:2.0:1788460729.454656:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753408 00000100:00100000:2.0:1788460729.454726:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:2.0:1788460729.454736:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17530:x1875336462753408:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460729.455780:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17530:x1875336462753408:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1041us (2222us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788460729.455807:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 11 00000100:00100000:0.0:1788460729.460856:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.461015:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753664 00000100:00100000:3.0:1788460729.461024:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753664 00000100:00100000:3.0:1788460729.461221:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:3.0:1788460729.461233:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17530:x1875336462753664:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460729.461350:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17530:x1875336462753664:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.461367:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 55 00000100:00100000:2.0:1788460729.464617:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.464708:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753792 00000100:00100000:3.0:1788460729.464718:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753792 00000100:00100000:3.0:1788460729.464856:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:3.0:1788460729.464867:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:17530:x1875336462753792:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.464886:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460729.464915:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d197f expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.464980:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.464995:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.465006:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460729.465056:0:19035:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788460729.465074:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.465098:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d197f expref: 17 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.465115:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d197f expref: 16 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.465123:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:3.0:1788460729.465125:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460729.465129:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc4c00, rc 0) 00000100:00100000:3.0:1788460729.465266:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17530:x1875336462753792:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 400us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.465273:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 56 00000100:00100000:2.0:1788460729.474515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460729.477325:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462753920 00000100:00100000:1.0:1788460729.477340:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462753920 00000100:00100000:1.0:1788460729.477565:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1788460729.477577:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2380:x1875336462753920:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460729.477596:0:19722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460729.477616:0:19722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1986 expref: -99 pid: 19722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460729.477643:0:19722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99beb8, blocks: 0x1 00010000:00010000:1.0:1788460729.477662:0:19722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=602s v=(0 0) 00010000:00010000:1.0:1788460729.477666:0:19722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460729.477676:0:19722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 7 pid: 19722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.477697:0:19722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 7 pid: 19722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.477710:0:19722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650d029d400, rc 0) 00000100:00100000:1.0:1788460729.477834:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2380:x1875336462753920:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 259us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460729.477841:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:3.0:1788460729.481725:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.481829:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754176 00000100:00100000:0.0:1788460729.481840:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754176 00000100:00100000:0.0:1788460729.481904:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:0.0:1788460729.481926:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17530:x1875336462754176:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788460729.482038:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17530:x1875336462754176:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 115us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460729.482047:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 57 00000100:00100000:2.0:1788460729.484495:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.484574:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754304 00000100:00100000:0.0:1788460729.484583:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754304 00000100:00100000:0.0:1788460729.484634:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 58 00000100:00100000:0.0:1788460729.484644:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17530:x1875336462754304:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788460729.533299:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+16:17530:x1875336462754304:12345-192.168.203.32@tcp:44:lhsmtool_posix.0 Request processed in 48645us (48813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460729.533312:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 58 00000001:00080000:2.0:1788460729.533347:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901917 is committed 00000004:00080000:2.0:1788460729.533361:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788460729.533377:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000100:00100000:3.0:1788460729.535901:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460729.537153:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482665984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788460729.537244:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460729.537407:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754432 00000100:00100000:3.0:1788460729.537415:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754432 00000100:00100000:3.0:1788460729.537738:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482665984 00000100:00100000:3.0:1788460729.537743:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482665984 00000100:00100000:3.0:1788460729.537787:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:3.0:1788460729.537796:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2379:x1875336462754432:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788460729.537882:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2379:x1875336462754432:12345-192.168.203.32@tcp:16:lhsmtool_posix.0 Request processed in 87us (1990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.537890:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00080000:0.0:1788460729.538119:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460729.538999:0:19719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460729.539014:0:19719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875336482665984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788460729.539174:0:19719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788460729.539194:0:19719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788460729.539197:0:19719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788460729.539199:0:19719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788460728 -> 1788460728 00002000:00010000:2.0:1788460729.539201:0:19719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788460729.544154:0:19719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1875336482665984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5136us (6900us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788460729.544248:0:19719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788460729.548218:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9650fcdc6300/2, rc 0, transno 12884901891 00000100:00100000:1.0:1788460729.548234:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482665984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788460729.548800:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.548871:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754688 00000100:00100000:3.0:1788460729.548879:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754688 00000100:00100000:3.0:1788460729.548992:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 59 00000100:00100000:3.0:1788460729.549002:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+13:17530:x1875336462754688:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.549062:0:19035:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460729.549088:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4c00/0x889bb893541b90b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d197f expref: 13 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.549106:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:3.0:1788460729.549111:0:19035:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460729.549137:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.549150:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.549160:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460729.549687:0:19035:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9873948 reply state 000000007c9ea166 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.549697:0:19035:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460729.549844:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:17530:x1875336462754688:12345-192.168.203.32@tcp:36:lhsmtool_posix.0 Request processed in 841us (1045us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1788460729.549852:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 59 00010000:00010000:0.0:1788460729.554002:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554019:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554027:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554033:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:0.0:1788460729.554038:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554046:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554063:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:0.0:1788460729.554080:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460729.554086:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.554092:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4200/0x889bb893541b90bf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.554295:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.554407:0:20259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754816 00000100:00100000:3.0:1788460729.554417:0:20259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754816 00000100:00100000:3.0:1788460729.554516:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:3.0:1788460729.554633:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:17530:x1875336462754816:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.554666:0:20259:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460729.554683:0:20259:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d198d expref: -99 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.554713:0:20259:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 8 pid: 19722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.554722:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460729.554726:0:20259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460729.554731:0:20259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 8 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.554838:0:20259:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 8 pid: 19722 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.554852:0:20259:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 8 pid: 19722 timeout: 702 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.554866:0:20259:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20259:1875336482666112:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460729.555247:0:20259:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788460729.558847:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.559104:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462754944 00000100:00100000:2.0:1788460729.559114:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462754944 00010000:00010000:2.0:1788460729.559151:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 9 pid: 19722 timeout: 702 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.559245:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460729.559255:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2380:x1875336462754944:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460729.559272:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460729.559291:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 9 pid: 19722 timeout: 702 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.559304:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 9 pid: 19722 timeout: 702 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.559327:0:19019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460729.559332:0:19019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460729.559339:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.559349:0:19019:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.559889:0:19019:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.559968:0:19019:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19019:1875336482666240:192.168.203.32@tcp:105: 00000100:00100000:2.0:1788460729.560093:0:19019:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fca42480 going to sleep for 11 seconds 00010000:00010000:3.0:1788460729.560825:0:20259:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c67d959/0x889bb893541b90b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1986 expref: 9 pid: 19722 timeout: 702 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.560845:0:20259:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:20259:1875336482666112:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460729.560871:0:20259:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 8 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.560898:0:20259:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650efdc5400, rc 0) 00000100:00100000:3.0:1788460729.560947:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+8:17530:x1875336462754816:12345-192.168.203.32@tcp:101:lhsmtool_posix.0 Request processed in 6413us (6939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.560955:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:2.0:1788460729.564508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.565004:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755072 00000100:00100000:0.0:1788460729.565014:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755072 00000100:00100000:0.0:1788460729.565072:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1788460729.565082:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fcdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+8:2379:x1875336462755072:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788460729.565309:0:19722:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788460729.565313:0:19722:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788460727 00002000:00010000:0.0:1788460729.565316:0:19722:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788460725 00002000:00010000:0.0:1788460729.565318:0:19722:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788460728 -> 1788460727 00002000:00010000:0.0:1788460729.565320:0:19722:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788460729.565387:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fcdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2379:x1875336462755072:12345-192.168.203.32@tcp:2:lhsmtool_posix.0 Request processed in 306us (888us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788460729.565394:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460729.567605:0:19019:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:19019:1875336482666240:192.168.203.32@tcp:105: 00010000:00010000:3.0:1788460729.567631:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460729.567817:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.567881:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755200 00000100:00100000:3.0:1788460729.567886:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755200 00000100:00100000:3.0:1788460729.567941:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460729.567950:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2380:x1875336462755200:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.567986:0:19721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.568004:0:19721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.568011:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460729.568016:0:19721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460729.568020:0:19721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.568053:0:19721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.568083:0:19721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.568096:0:19721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19721:1875336482666368:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460729.568159:0:19721:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460729.568222:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2380:x1875336462754944:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 8968us (9383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.568230:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 16 00000100:00100000:1.0:1788460729.571111:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.571209:0:19020:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755328 00000100:00100000:2.0:1788460729.571218:0:19020:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755328 00010000:00010000:2.0:1788460729.571254:0:19020:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.571300:0:19020:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:2.0:1788460729.571310:0:19020:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2379:x1875336462755328:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460729.571323:0:19020:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460729.571342:0:19020:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.571360:0:19020:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 9 pid: 20259 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.571394:0:19020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460729.571398:0:19020:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460729.571403:0:19020:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.571412:0:19020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.571432:0:19020:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460729.571492:0:19020:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+9:2379:x1875336462755328:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 168us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460729.571500:0:19020:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00010000:00010000:3.0:1788460729.572727:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ab202e/0x889bb893541b90c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d198d expref: 8 pid: 20259 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.572749:0:19721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19721:1875336482666368:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460729.572771:0:19721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572783:0:19721:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572791:0:19721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572818:0:19721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572843:0:19721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572851:0:19721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572858:0:19721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4c00 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:3.0:1788460729.572862:0:19721:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572871:0:19721:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572885:0:19721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.572893:0:19721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fbd8d65/0x889bb893541b90cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.572976:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd3c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:2380:x1875336462755200:12345-192.168.203.32@tcp:1:lhsmtool_posix.0 Request processed in 5026us (5158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.572985:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:1.0:1788460729.576413:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.576575:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755584 00000100:00100000:3.0:1788460729.576585:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755584 00000100:00100000:3.0:1788460729.576685:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 60 00000100:00100000:3.0:1788460729.576711:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+13:17530:x1875336462755584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460729.576789:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.576806:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.576818:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.577069:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.577081:0:20910:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 14 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.577090:0:20910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.577121:0:20910:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 14 pid: 19036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.577134:0:20910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 14 pid: 19036 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.577149:0:20910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20910:1875336482666496:192.168.203.32@tcp:104: 00000100:00100000:3.0:1788460729.577259:0:20910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650fc96f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460729.579517:0:20910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20910:1875336482666496:192.168.203.32@tcp:104: 00010000:00010000:3.0:1788460729.579545:0:20910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460729.581084:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460729.581157:0:19019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755712 00000100:00100000:3.0:1788460729.581166:0:19019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755712 00010000:00010000:3.0:1788460729.581237:0:19019:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 15 pid: 19036 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460729.581279:0:19019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460729.581289:0:19019:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+15:2380:x1875336462755712:12345-192.168.203.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460729.581303:0:19019:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460729.581310:0:19019:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 15 pid: 19036 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581323:0:19019:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 15 pid: 19036 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581344:0:19019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55400/0x889bb893541b90a3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1978 expref: 15 pid: 19036 timeout: 702 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581370:0:19019:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:3.0:1788460729.581374:0:19019:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581383:0:19019:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581391:0:19019:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460729.581421:0:19019:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460729.581498:0:19019:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+14:2380:x1875336462755712:12345-192.168.203.32@tcp:103:ldlm_bl.0 Request processed in 209us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.581505:0:19019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00010000:00010000:1.0:1788460729.581613:0:20910:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.581622:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460729.581801:0:20910:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:1.0:1788460729.581942:0:20910:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:1.0:1788460729.581983:0:20910:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:1.0:1788460729.582058:0:20910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20910:1875336482666624:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788460729.582125:0:20910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460729.582161:0:20910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5e2bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460729.583289:0:19039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482666624 00000100:00100000:3.0:1788460729.583301:0:19039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482666624 00000100:00100000:3.0:1788460729.583354:0:19039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460729.583376:0:19039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20910:x1875336482666624:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788460729.583471:0:19039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:20910:x1875336482666624:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.583492:0:19039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460729.583724:0:20910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20910:1875336482666624:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788460729.584431:0:20910:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:1.0:1788460729.584750:0:20910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20910:1875336482666752:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788460729.584796:0:20910:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460729.584827:0:20910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5e2b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460729.584899:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482666752 00000100:00100000:0.0:1788460729.584916:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482666752 00000100:00100000:0.0:1788460729.584944:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460729.584953:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20910:x1875336482666752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788460729.585109:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20910:x1875336482666752:12345-0@lo:1000:mdt00_003.0 Request processed in 157us (313us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788460729.585117:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460729.585297:0:20910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20910:1875336482666752:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788460729.585329:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585351:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585369:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585376:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5600 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460729.585380:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585389:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585403:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:1.0:1788460729.585406:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460729.585410:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585417:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5600/0x889bb893541b90db lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585445:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585451:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585456:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585461:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc5000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:1.0:1788460729.585468:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585475:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585962:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:1.0:1788460729.585965:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460729.585972:0:20910:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585983:0:20910:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.585992:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.586016:0:20910:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff964fc1ea5400/0x889bb893541b903a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d195c expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460729.586028:0:20910:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20910:1875336482666880:192.168.203.32@tcp:105: 00000100:00100000:1.0:1788460729.586093:0:20910:0:(client.c:2716:ptlrpc_set_wait()) set ffff9650c5e2b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460729.589628:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.589755:0:20910:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650c75c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20910:1875336482666880:192.168.203.32@tcp:105: 00010000:00010000:2.0:1788460729.589801:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589810:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc5000/0x889bb893541b9033 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589840:0:20910:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589852:0:20910:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589862:0:20910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589872:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589878:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589883:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589888:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d55c00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.589892:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589899:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589920:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:2.0:1788460729.589930:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460729.589935:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589941:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90e2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589952:0:20910:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589958:0:20910:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589964:0:20910:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589968:0:20910:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650efdc4400 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.589971:0:20910:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589977:0:20910:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589984:0:20910:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:2.0:1788460729.589987:0:20910:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460729.589989:0:20910:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.589994:0:20910:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650efdc4400/0x889bb893541b90d4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20910 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.590255:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:070896ab-fc36-4f97-80f6-7a8728f1dddc+17:17530:x1875336462755584:12345-192.168.203.32@tcp:57:lhsmtool_posix.0 Request processed in 13546us (13903us total) trans 12884901924 rc 0/0 00000100:00100000:2.0:1788460729.590274:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 60 00000020:00080000:2.0:1788460729.590280:0:20910:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788460729.590471:0:19069:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788460729.590491:0:19069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460729.590521:0:19069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788460729.590527:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788460729.591173:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755840 00000100:00100000:3.0:1788460729.591222:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755840 00000100:00100000:3.0:1788460729.591265:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:3.0:1788460729.591274:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+17:17528:x1875336462755840:12345-192.168.203.32@tcp:49:bash.0 00000100:00100000:3.0:1788460729.591392:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+17:17528:x1875336462755840:12345-192.168.203.32@tcp:49:bash.0 Request processed in 119us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460729.591399:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 12 00000100:00100000:1.0:1788460729.595223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.595400:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462755968 00000100:00100000:0.0:1788460729.595410:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462755968 00000100:00100000:0.0:1788460729.595468:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1788460729.595491:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+7:17528:x1875336462755968:12345-192.168.203.32@tcp:101:bash.0 00010000:00010000:0.0:1788460729.595511:0:19722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460729.595534:0:19722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b374f23/0x889bb893541b90e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d1994 expref: -99 pid: 19722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460729.595559:0:19722:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a99beb7, atime: 0x6a99beb5, ctime: 0x6a99beb7, blocks: 0x1 00010000:00010000:0.0:1788460729.595584:0:19722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788460729.595589:0:19722:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460729.595598:0:19722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b374f23/0x889bb893541b90e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1994 expref: 8 pid: 19722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.595616:0:19722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b374f23/0x889bb893541b90e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d1994 expref: 8 pid: 19722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460729.595627:0:19722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff964fc1ea5000, rc 0) 00000100:00100000:0.0:1788460729.595692:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+8:17528:x1875336462755968:12345-192.168.203.32@tcp:101:bash.0 Request processed in 215us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460729.595699:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:0.0:1788460729.599375:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460729.599412:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:1.0:1788460729.599838:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462756224 00000100:00100000:1.0:1788460729.599849:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462756224 00000100:00100000:1.0:1788460729.599885:0:19038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462756480 00000100:00100000:1.0:1788460729.599887:0:19038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462756480 00000100:00100000:1.0:1788460729.599899:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 13 00000100:00100000:1.0:1788460729.599968:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+18:17528:x1875336462756224:12345-192.168.203.32@tcp:35:bash.0 00000001:00080000:1.0:1788460729.600646:0:19038:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000001:00080000:1.0:1788460729.600749:0:19038:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00000100:00100000:1.0:1788460729.600934:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+21:17528:x1875336462756224:12345-192.168.203.32@tcp:35:bash.0 Request processed in 968us (1759us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1788460729.600943:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 13 00000020:00080000:1.0:1788460729.600948:0:19038:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788460729.600968:0:19038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 14 00000100:00100000:1.0:1788460729.600977:0:19038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+20:17530:x1875336462756480:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788460729.601806:0:19038:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788460729.601925:0:19038:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00010000:00010000:1.0:1788460729.601968:0:19038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.601986:0:19038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.601999:0:19038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.602008:0:19038:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.602014:0:19038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.602020:0:19038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460729.602472:0:19038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460729.602556:0:19038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+22:17530:x1875336462756480:12345-192.168.203.32@tcp:35:lhsmtool_posix.0 Request processed in 1577us (3140us total) trans 12884901929 rc 0/0 00000100:00100000:1.0:1788460729.602572:0:19038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 14 00000020:00080000:1.0:1788460729.602578:0:19038:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788460729.613063:0:20262:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460729.613077:0:20262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.613089:0:20262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650d029c600 already unused, calling callback (ffffffffc16fc700) 00010000:00010000:2.0:1788460729.613094:0:20262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.613103:0:20262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.613122:0:20262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9650c7412e00) 00010000:00010000:2.0:1788460729.613125:0:20262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788460729.613129:0:20262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.613136:0:20262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650d029c600/0x889bb893541b90f0 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19038 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.613149:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460729.613151:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460729.613153:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460729.702240:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.702392:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462756736 00000100:00100000:2.0:1788460729.702404:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462756736 00000100:00100000:2.0:1788460729.702454:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:2.0:1788460729.702464:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+22:17540:x1875336462756736:12345-192.168.203.32@tcp:101:lfs.0 00010000:00010000:2.0:1788460729.702503:0:21022:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460729.702532:0:21022:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x28701a8d076d199b expref: -99 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460729.702629:0:21022:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788460729.702747:0:21022:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d199b expref: 24 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.702761:0:21022:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9650c34d0f00) 00010000:00010000:2.0:1788460729.702764:0:21022:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460729.702769:0:21022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d55c00/0x889bb893541b90f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.32@tcp remote: 0x28701a8d076d199b expref: 24 pid: 21022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.702784:0:21022:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9650e6d55c00, rc 0) 00000100:00100000:2.0:1788460729.702850:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17540:x1875336462756736:12345-192.168.203.32@tcp:101:lfs.0 Request processed in 387us (618us total) trans 12884901930 rc 301/301 00000100:00100000:2.0:1788460729.702857:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 61 00000100:00100000:3.0:1788460729.705987:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.706084:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462756864 00000100:00100000:2.0:1788460729.706094:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462756864 00000100:00100000:2.0:1788460729.706152:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:2.0:1788460729.706162:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17540:x1875336462756864:12345-192.168.203.32@tcp:34:lfs.0 00010000:00010000:2.0:1788460729.706253:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706270:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706281:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706297:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706317:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706325:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706762:0:19035:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706771:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706778:0:19035:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460729.706818:0:19035:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706830:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706836:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706842:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706848:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54000 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.706851:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706859:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706878:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9650c52ed700) 00010000:00010000:2.0:1788460729.706880:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460729.706885:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706891:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54000/0x889bb893541b9105 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706904:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706909:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706914:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706918:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54e00 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.706921:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706926:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706932:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9650c34d0700) 00010000:00010000:2.0:1788460729.706934:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460729.706937:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706942:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54e00/0x889bb893541b910c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706966:0:19035:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706971:0:19035:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706976:0:19035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706980:0:19035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9650e6d54200 already unused, calling callback (ffffffffc21494f0) 00010000:00010000:2.0:1788460729.706983:0:19035:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706989:0:19035:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.706996:0:19035:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9650c52ed300) 00010000:00010000:2.0:1788460729.706998:0:19035:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460729.707001:0:19035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460729.707007:0:19035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9650e6d54200/0x889bb893541b9113 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19035 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460729.707669:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17540:x1875336462756864:12345-192.168.203.32@tcp:34:lfs.0 Request processed in 1502us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460729.707680:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 62 00000100:00100000:3.0:1788460729.711296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:2.0:1788460729.711463:0:19037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757120 00000100:00100000:2.0:1788460729.711472:0:19037:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757120 00000100:00100000:2.0:1788460729.711538:0:19037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 15 00000100:00100000:2.0:1788460729.711563:0:19037:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+23:17540:x1875336462757120:12345-192.168.203.32@tcp:35:lfs.0 00000100:00100000:2.0:1788460729.711791:0:19037:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:17540:x1875336462757120:12345-192.168.203.32@tcp:35:lfs.0 Request processed in 230us (502us total) trans 12884901931 rc 0/0 00000100:00100000:2.0:1788460729.711799:0:19037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 15 00010000:00010000:2.0:1788460729.742209:0:19022:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460730.764610:0:19023:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460731.330573:0:21203:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:0.0:1788460731.660505:0:19069:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788460731.660526:0:19069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460731.660560:0:19069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788460731.660568:0:19069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788460731.788352:0:20262:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460731.916531:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460731.916555:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482667008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460731.916627:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460731.916713:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482667136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.916749:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460731.924494:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482667392:0@lo:400:kworker.0 00000100:00100000:1.0:1788460731.924575:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460731.927543:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482667648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.927625:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460731.927675:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788460731.927683:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482667264:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.927716:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460731.927740:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482667776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.927765:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460731.928055:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667392 00000100:00100000:0.0:1788460731.928063:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667392 00000100:00100000:0.0:1788460731.928118:0:19721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667264 00000100:00100000:0.0:1788460731.928121:0:19721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667264 00000100:00100000:0.0:1788460731.928147:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460731.928157:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482667392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928371:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482667392:12345-0@lo:400:kworker.0 Request processed in 215us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460731.928381:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460731.928401:0:19721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460731.928410:0:19721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482667264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928448:0:19721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1875336482667264:12345-0@lo:400:kworker.0 Request processed in 40us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460731.928455:0:19721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788460731.928498:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667648 00000100:00100000:0.0:1788460731.928502:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667648 00000100:00100000:0.0:1788460731.928530:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667776 00000100:00100000:0.0:1788460731.928533:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667776 00000100:00100000:0.0:1788460731.928557:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460731.928564:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482667648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928606:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1875336482667648:12345-0@lo:400:kworker.0 Request processed in 38us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460731.928614:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788460731.928632:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460731.928637:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460731.928639:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460731.928658:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460731.928667:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482667776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928702:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650d831e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1875336482667776:12345-0@lo:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460731.928708:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460731.928754:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3316:1875336482667776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928768:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3316:1875336482667648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460731.928796:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3316:1875336482667264:0@lo:400:kworker.0 00000100:00100000:3.0:1788460731.928884:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9650fcdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482667520:0@lo:400:kworker.0 00000100:00100000:3.0:1788460731.928919:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460731.929013:0:20910:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667520 00000100:00100000:3.0:1788460731.929018:0:20910:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667520 00000100:00100000:3.0:1788460731.929050:0:20910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460731.929058:0:20910:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482667520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460731.929103:0:20910:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875336482667520:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460731.929118:0:20910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460731.929150:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875336482667520:0@lo:400:kworker.0 00000100:00100000:3.0:1788460731.929301:0:19723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667008 00000100:00100000:3.0:1788460731.929306:0:19723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667008 00000100:00100000:3.0:1788460731.929332:0:19723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460731.929339:0:19723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482667008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460731.929366:0:19723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788460731.929402:0:19723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650c75cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875336482667008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (12776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460731.929410:0:19723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460731.929717:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482667392:0@lo:400:kworker.0 00000100:00100000:1.0:1788460731.929734:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650efcfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3318:1875336482667008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460731.940261:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336482667136 00000100:00100000:2.0:1788460731.940277:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336482667136 00000100:00100000:2.0:1788460731.940346:0:19028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788460731.940356:0:19028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482667136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460731.940444:0:19028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650fd25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:13026af2-46ad-415c-9f59-ba32734436e0+23:3316:x1875336482667136:12345-0@lo:400:kworker.0 Request processed in 90us (23694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460731.940452:0:19028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788460731.940519:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9650fcdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:13026af2-46ad-415c-9f59-ba32734436e0:3316:1875336482667136:0@lo:400:kworker.0 00000001:00080000:1.0:1788460732.015424:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00000001:00080000:1.0:1788460732.015442:0:7671:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000100:00100000:3.0:1788460732.138551:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460732.138594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460732.138638:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460732.138643:0:19029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757248 00000100:00100000:0.0:1788460732.138656:0:19029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757248 00000100:00100000:3.0:1788460732.138673:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460732.138703:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:0.0:1788460732.138715:0:19029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:0.0:1788460732.138727:0:19029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+14:2379:x1875336462757248:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460732.138729:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460732.138761:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.32@tcp (source: 12345-192.168.203.32@tcp) 00000100:00100000:3.0:1788460732.138788:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757504 00000100:00100000:3.0:1788460732.138793:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757504 00000100:00100000:0.0:1788460732.138808:0:19029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff964fc3e01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:33947916-367f-49ef-b7e1-278b016d1427+14:2379:x1875336462757248:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460732.138829:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462758016 00000100:00100000:3.0:1788460732.138834:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462758016 00000100:00100000:0.0:1788460732.138837:0:19029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 142 00000100:00100000:3.0:1788460732.138852:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757632 00000100:00100000:3.0:1788460732.138856:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757632 00000100:00100000:3.0:1788460732.138874:0:19722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757888 00000100:00100000:3.0:1788460732.138876:0:19722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757888 00000100:00100000:3.0:1788460732.138903:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:3.0:1788460732.138911:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2379:x1875336462757504:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460732.138920:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:0.0:1788460732.138934:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462758016:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460732.138963:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+5:2379:x1875336462757504:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 51us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460732.138971:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 17 00000100:00100000:0.0:1788460732.138977:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462758016:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 44us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460732.138986:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 18 00000100:00100000:3.0:1788460732.139004:0:19722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 19 00000100:00100000:3.0:1788460732.139013:0:19722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2379:x1875336462757632:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:3.0:1788460732.139037:0:19722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:070896ab-fc36-4f97-80f6-7a8728f1dddc+6:2379:x1875336462757632:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 26us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460732.139105:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757760 00000100:00100000:2.0:1788460732.139110:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757760 00000100:00100000:2.0:1788460732.139141:0:21022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336462757376 00000100:00100000:2.0:1788460732.139144:0:21022:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336462757376 00000100:00100000:2.0:1788460732.139170:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:2.0:1788460732.139212:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2379:x1875336462757760:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460732.139250:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650efcfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+6:2379:x1875336462757760:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 73us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460732.139256:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 26 00000100:00100000:2.0:1788460732.139280:0:21022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00100000:2.0:1788460732.139287:0:21022:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:2379:x1875336462757376:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:2.0:1788460732.139316:0:21022:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:070896ab-fc36-4f97-80f6-7a8728f1dddc+24:2379:x1875336462757376:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 31us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460732.139322:0:21022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 27 00000100:00080000:2.0:1788460732.139352:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460732.139357:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460732.139358:0:19030:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460732.139756:0:20259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:0.0:1788460732.139766:0:20259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9650f5e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462757888:12345-192.168.203.32@tcp:400:kworker.0 00000100:00100000:0.0:1788460732.139802:0:20259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9650f5e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6a6dc80-b95c-4d0f-8c3e-bf625122869e+5:2379:x1875336462757888:12345-192.168.203.32@tcp:400:kworker.0 Request processed in 39us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460732.139809:0:20259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 20 00000100:00100000:3.0:1788460732.143538:0:19722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.32@tcp, seq: 19 Debug log: 10596 lines, 10596 kept, 0 dropped, 0 bad.