00000100:00100000:3.0F:1788658639.777184:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658639.777232:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103822336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658639.777317:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788658639.777557:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822336 00000100:00100000:1.0:1788658639.777572:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822336 00000100:00100000:1.0:1788658639.777632:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788658639.777643:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103822336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658639.777703:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658639.777763:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff645500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103822336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658639.777771:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658639.777916:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103822336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0F:1788658640.092916:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658640.560879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.560922:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.560954:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.560981:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.560998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.561016:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.561039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658640.561068:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579072 00000100:00100000:1.0:1788658640.561077:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579072 00000100:00100000:1.0:1788658640.561134:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579456 00000100:00100000:1.0:1788658640.561138:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579456 00000100:00100000:1.0:1788658640.561163:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:1.0:1788658640.561174:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+20:2351:x1875544076579072:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561251:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59fc9cf2-29f7-4afb-a889-1aea3676cd57+20:2351:x1875544076579072:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 79us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561258:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:1.0:1788658640.561278:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658640.561284:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076579456:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561325:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076579456:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 41us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561349:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1788658640.561371:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579328 00000100:00100000:1.0:1788658640.561375:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579328 00000100:00100000:1.0:1788658640.561393:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579584 00000100:00100000:1.0:1788658640.561395:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579584 00000100:00100000:1.0:1788658640.561405:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579200 00000100:00100000:1.0:1788658640.561407:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579200 00000100:00100000:1.0:1788658640.561417:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579712 00000100:00100000:1.0:1788658640.561419:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579712 00000100:00100000:1.0:1788658640.561432:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:1.0:1788658640.561438:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076579328:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561462:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076579328:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561467:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:1.0:1788658640.561477:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1788658640.561482:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076579584:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561502:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076579584:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561507:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1788658640.561515:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658640.561520:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076579200:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561540:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2351:x1875544076579200:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561546:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658640.561556:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1788658640.561569:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076579712:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561595:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2351:x1875544076579712:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561601:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1788658640.561623:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076578944 00000100:00100000:1.0:1788658640.561626:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076578944 00000100:00100000:1.0:1788658640.561660:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:1.0:1788658640.561696:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076578944:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658640.561736:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076578944:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 41us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658640.561742:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00080000:1.0:1788658640.561777:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658640.561781:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658640.561784:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1788658640.907607:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000001:00080000:2.0:1788658640.907638:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934617 is committed 00000001:00080000:2.0:1788658640.907686:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:2.0:1788658640.907698:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9e56fbaca840 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1788658640.907703:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56faebc800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9e56fbaca480 00000020:00080000:2.0:1788658640.907707:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9e56faebcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9e55c329f400 00000020:00080000:2.0:1788658640.907726:0:14455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:2.0:1788658640.907931:0:14455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788658641.117892:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658642.167771:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658642.355749:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658642.355791:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076579840 00000100:00100000:3.0:1788658642.355801:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076579840 00000100:00100000:3.0:1788658642.355869:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1788658642.355880:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:14443:x1875544076579840:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788658642.355999:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff644a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:14443:x1875544076579840:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658642.356008:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00080000:3.0:1788658642.356029:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658642.357742:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658642.357775:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580096 00000100:00100000:3.0:1788658642.357784:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580096 00000100:00100000:3.0:1788658642.357826:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1788658642.357836:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:14443:x1875544076580096:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658642.358170:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff646300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+13:14443:x1875544076580096:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 334us (434us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788658642.358178:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00010000:00010000:2.0:1788658643.228980:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658644.255300:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658644.384060:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103822720:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.384087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103822848:0@lo:400:kworker.0 00000100:00100000:0.0F:1788658644.384181:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103822464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658644.384187:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103822592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.388707:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658644.388797:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658644.388812:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103823232:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.388889:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658644.388945:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822848 00000100:00100000:3.0:1788658644.388955:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822848 00000100:00100000:3.0:1788658644.389015:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658644.389024:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103822848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.389078:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103822848:12345-0@lo:400:kworker.0 Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.389085:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788658644.389105:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658644.389132:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103822848:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.389163:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823232 00000100:00100000:3.0:1788658644.389167:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823232 00000100:00100000:3.0:1788658644.389211:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788658644.389218:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103823232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.389254:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103823232:12345-0@lo:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.389260:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788658644.389274:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658644.389299:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103823232:0@lo:400:kworker.0 00000100:00100000:0.0:1788658644.396503:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658644.396572:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103822976:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.396581:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822464 00000100:00100000:3.0:1788658644.396591:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822464 00000100:00100000:0.0:1788658644.396616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658644.396651:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822976 00000100:00100000:0.0:1788658644.396655:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822976 00000100:00100000:3.0:1788658644.396659:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788658644.396686:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103822464:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658644.396698:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788658644.396704:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103822976:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788658644.396722:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658644.396745:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103822976:12345-0@lo:400:kworker.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.396753:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658644.396754:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103822464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.396775:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658644.396929:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103822464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658644.396946:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103822976:0@lo:400:kworker.0 00000100:00100000:2.0:1788658644.397000:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.397006:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658644.397091:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822720 00000100:00100000:3.0:1788658644.397096:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822720 00000100:00100000:3.0:1788658644.397145:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658644.397152:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103822720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.397221:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103822720:12345-0@lo:400:kworker.0 Request processed in 70us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.397229:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658644.397254:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103822720:0@lo:400:kworker.0 00000100:00100000:1.0:1788658644.397533:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103823104:0@lo:400:kworker.0 00000100:00100000:1.0:1788658644.397562:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788658644.398099:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658644.398155:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823104 00000100:00100000:3.0:1788658644.398161:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823104 00000100:00080000:2.0:1788658644.398340:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658644.398458:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788658644.398469:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103823104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.398533:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103823104:12345-0@lo:400:kworker.0 Request processed in 67us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658644.398540:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788658644.398713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103823104:0@lo:400:kworker.0 00000100:00100000:0.0:1788658644.398947:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103822592 00000100:00100000:0.0:1788658644.398953:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103822592 00000100:00100000:0.0:1788658644.399034:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788658644.399043:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103822592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658644.399094:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103822592:12345-0@lo:400:kworker.0 Request processed in 52us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658644.399101:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788658644.399172:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103822592:0@lo:400:kworker.0 00000100:00100000:3.0:1788658644.895104:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103823360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658644.895174:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658644.895285:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823360 00000100:00100000:1.0:1788658644.895308:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823360 00000100:00100000:1.0:1788658644.895367:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788658644.895376:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103823360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658644.895413:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658644.895459:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103823360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658644.895466:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658644.895637:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103823360:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788658645.021125:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658645.021136:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658645.021173:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788658645.021180:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788658645.279976:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658645.685587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.685727:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.685754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.685776:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.685796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.685828:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658645.686044:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580608 00000100:00100000:3.0:1788658645.686056:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580608 00000100:00100000:3.0:1788658645.686172:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580480 00000100:00100000:3.0:1788658645.686177:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580480 00000100:00100000:3.0:1788658645.686195:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580864 00000100:00100000:3.0:1788658645.686198:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580864 00000100:00100000:3.0:1788658645.686216:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:3.0:1788658645.686225:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076580480:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658645.686303:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2354:x1875544076580480:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 78us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.686312:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:3.0:1788658645.686329:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658645.686335:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2350:x1875544076580608:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:3.0:1788658645.686354:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebe80 00000100:00080000:3.0:1788658645.686515:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9e56db3f3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658645.686558:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788658645.686808:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+2:2350:x1875544076580608:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 472us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.686815:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658645.686828:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658645.686834:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2350:x1875544076580864:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:3.0:1788658645.687009:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebeb1 00000100:00080000:3.0:1788658645.687017:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9e56db087800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788658645.687040:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788658645.687166:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+2:2350:x1875544076580864:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 331us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.687183:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1788658645.687205:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580224 00000100:00100000:3.0:1788658645.687209:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580224 00000100:00100000:3.0:1788658645.687237:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:3.0:1788658645.687244:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d002fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2354:x1875544076580224:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658645.687271:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d002fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2354:x1875544076580224:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.687278:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:3.0:1788658645.687309:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580352 00000100:00100000:3.0:1788658645.687313:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580352 00000100:00100000:3.0:1788658645.687341:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580736 00000100:00100000:3.0:1788658645.687345:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580736 00000100:00100000:3.0:1788658645.687364:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:3.0:1788658645.689107:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+13:2354:x1875544076580352:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658645.689211:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+13:2354:x1875544076580352:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1834us (3428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.689224:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:3.0:1788658645.689263:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:3.0:1788658645.689276:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2353:x1875544076580736:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658645.689306:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d29d269-69a5-47bf-9218-df6c9b443069+6:2353:x1875544076580736:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 35us (3509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658645.689311:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00080000:3.0:1788658645.689342:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788658645.689348:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788658645.689351:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788658645.690945:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658645.690956:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658645.693576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658645.693620:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076580992 00000100:00100000:1.0:1788658645.693630:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076580992 00000100:00100000:1.0:1788658645.693854:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1788658645.693866:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+5:2350:x1875544076580992:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:1.0:1788658645.693906:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebeb8 00000100:00080000:1.0:1788658645.693917:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9e56db083800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658645.693955:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788658645.694150:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d29d269-69a5-47bf-9218-df6c9b443069+2:2350:x1875544076580992:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 285us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658645.694158:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00080000:1.0:1788658645.694177:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788658645.694361:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788658645.979297:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000001:00080000:0.0:1788658645.979326:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000020:00080000:0.0:1788658645.979339:0:14455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:0.0:1788658645.980107:0:14455:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00010000:00010000:2.0:1788658646.301027:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658647.016090:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00000020:00000080:1.0:1788658647.016100:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e56db083000/9d29d269-69a5-47bf-9218-df6c9b443069 00000020:00000080:3.0:1788658647.016165:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db083000/9d29d269-69a5-47bf-9218-df6c9b443069 for lustre-OST0000 00000020:00000080:3.0:1788658647.016219:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56db087800 for lustre-OST0000 00010000:00010000:0.0:1788658647.328268:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658648.350770:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658649.373239:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658649.501835:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103823872:0@lo:400:kworker.0 00000100:00100000:3.0:1788658649.501908:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658649.501973:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658649.501979:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103823744:0@lo:400:kworker.0 00000100:00100000:3.0:1788658649.502008:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658649.502160:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823872 00000100:00100000:1.0:1788658649.502169:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823872 00000100:00100000:1.0:1788658649.502225:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658649.502234:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103823872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.502288:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103823872:12345-0@lo:400:kworker.0 Request processed in 55us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658649.502295:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788658649.502344:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823744 00000100:00100000:1.0:1788658649.502348:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823744 00000100:00100000:1.0:1788658649.502384:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658649.502390:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103823744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.502456:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103823744:12345-0@lo:400:kworker.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658649.502463:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788658649.502480:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788658649.502919:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103823744:0@lo:400:kworker.0 00000100:00100000:2.0:1788658649.504095:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103823616:0@lo:400:kworker.0 00000100:00100000:2.0:1788658649.504172:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658649.504206:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103824128:0@lo:400:kworker.0 00000100:00100000:2.0:1788658649.504234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658649.504258:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788658649.504264:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103823488:0@lo:400:kworker.0 00000100:00100000:2.0:1788658649.504291:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658649.504334:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103824000:0@lo:400:kworker.0 00000100:00100000:2.0:1788658649.504356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658649.504653:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823616 00000100:00100000:1.0:1788658649.504661:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823616 00000100:00100000:1.0:1788658649.504750:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658649.504771:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103823616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.504827:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103823616:12345-0@lo:400:kworker.0 Request processed in 59us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658649.504836:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658649.504879:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103823616:0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.504914:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103823872:0@lo:400:kworker.0 00000100:00100000:3.0:1788658649.505275:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824128 00000100:00100000:3.0:1788658649.505281:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824128 00000100:00100000:3.0:1788658649.505312:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824000 00000100:00100000:3.0:1788658649.505316:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824000 00000100:00100000:3.0:1788658649.505338:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658649.505346:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103824128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658649.505390:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103824128:12345-0@lo:400:kworker.0 Request processed in 45us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658649.505396:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658649.505409:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658649.505415:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103824000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658649.505443:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103824000:12345-0@lo:400:kworker.0 Request processed in 28us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658649.505448:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788658649.505712:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103823488 00000100:00100000:0.0:1788658649.505718:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103823488 00000100:00100000:0.0:1788658649.505761:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788658649.505768:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103823488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658649.505802:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103823488:12345-0@lo:400:kworker.0 Request processed in 35us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658649.505807:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788658649.505944:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103823488:0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.505956:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103824000:0@lo:400:kworker.0 00000100:00100000:1.0:1788658649.505964:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103824128:0@lo:400:kworker.0 00000100:00080000:2.0:1788658649.506042:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658649.506047:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658649.508567:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658649.508641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658649.508771:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824256 00000100:00100000:3.0:1788658649.508780:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824256 00000100:00100000:3.0:1788658649.508842:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658649.508853:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658649.508904:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658649.508968:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658649.508975:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788658649.509509:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824256:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788658649.588510:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00000020:00000080:3.0:1788658649.588520:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56db087000/9d29d269-69a5-47bf-9218-df6c9b443069 00000001:00100000:3.0:1788658649.588540:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000020:00000080:3.0:1788658649.588543:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56db3f6800/59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000020:00000080:0.0:1788658649.589610:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db087000/9d29d269-69a5-47bf-9218-df6c9b443069 for lustre-OST0001 00000020:00000080:0.0:1788658649.589658:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db3f6800/59fc9cf2-29f7-4afb-a889-1aea3676cd57 for lustre-OST0001 00000020:00000080:0.0:1788658649.590597:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56db083800 for lustre-OST0001 00000020:00000080:0.0:1788658649.590604:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56db3f3800 for lustre-OST0001 00000100:00100000:1.0:1788658650.013350:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658650.013372:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658650.013435:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658650.014040:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824384 00000100:00100000:3.0:1788658650.014049:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824384 00000100:00100000:3.0:1788658650.014117:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658650.014128:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658650.014166:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788658650.014226:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658650.014232:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658650.014278:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788658650.399114:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658650.791330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658650.791384:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658650.791416:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658650.791446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658650.791473:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581120 00000100:00100000:3.0:1788658650.791483:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581120 00000100:00100000:3.0:1788658650.791530:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:3.0:1788658650.791541:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2353:x1875544076581120:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658650.791610:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2353:x1875544076581120:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 70us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658650.791630:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:3.0:1788658650.791661:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581376 00000100:00100000:3.0:1788658650.791711:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581376 00000100:00100000:3.0:1788658650.791749:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:3.0:1788658650.791756:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e6bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2353:x1875544076581376:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658650.791785:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e6bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2353:x1875544076581376:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658650.791791:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1788658650.791932:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581248 00000100:00100000:2.0:1788658650.791936:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581248 00000100:00100000:2.0:1788658650.791966:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581504 00000100:00100000:2.0:1788658650.791970:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581504 00000100:00100000:2.0:1788658650.791990:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1788658650.791997:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:2353:x1875544076581248:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658650.792028:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:2353:x1875544076581248:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658650.792034:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1788658650.792047:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:2.0:1788658650.792054:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+6:2353:x1875544076581504:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658650.792076:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+6:2353:x1875544076581504:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658650.792083:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00080000:2.0:1788658650.792114:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658650.792119:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788658651.427367:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658651.494102:0:17356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:37:29 (1788658649) 00010000:00010000:2.0:1788658652.444938:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658653.470003:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658654.493045:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658654.622438:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103824640:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622612:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103825152:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622695:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788658654.622702:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103824512:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622734:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622757:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622781:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622810:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622854:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658654.622859:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103824896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.622883:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658654.622918:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824640 00000100:00100000:1.0:1788658654.622927:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824640 00000100:00100000:1.0:1788658654.622988:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824768 00000100:00100000:1.0:1788658654.622992:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824768 00000100:00100000:1.0:1788658654.623017:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658654.623027:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103824640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623083:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103824640:12345-0@lo:400:kworker.0 Request processed in 59us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.623092:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788658654.623108:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658654.623133:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623165:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103824768:12345-0@lo:400:kworker.0 Request processed in 34us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.623171:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658654.623189:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825152 00000100:00100000:1.0:1788658654.623192:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825152 00000100:00100000:1.0:1788658654.623229:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825024 00000100:00100000:1.0:1788658654.623232:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825024 00000100:00100000:1.0:1788658654.623249:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824896 00000100:00100000:1.0:1788658654.623251:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824896 00000100:00100000:1.0:1788658654.623263:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658654.623270:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103825152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623300:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875544103825152:12345-0@lo:400:kworker.0 Request processed in 31us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.623306:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788658654.623315:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658654.623326:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103825024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623351:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875544103825024:12345-0@lo:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.623357:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788658654.623368:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658654.623374:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103824896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623400:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103824896:12345-0@lo:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658654.623406:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788658654.623471:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103824896:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623495:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103824768:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623535:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103825024:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623546:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103824640:0@lo:400:kworker.0 00000100:00100000:1.0:1788658654.623555:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875544103825152:0@lo:400:kworker.0 00000100:00100000:0.0:1788658654.623742:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103824512 00000100:00100000:0.0:1788658654.623748:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103824512 00000100:00100000:0.0:1788658654.623789:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788658654.623797:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103824512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658654.623837:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103824512:12345-0@lo:400:kworker.0 Request processed in 42us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658654.623844:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788658654.623881:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103824512:0@lo:400:kworker.0 00000100:00080000:2.0:1788658654.624083:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788658654.624090:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788658654.624092:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658654.624414:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788658654.624426:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658654.624469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658654.626151:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825280 00000100:00100000:3.0:1788658654.626169:0:15103:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825280 00000100:00100000:3.0:1788658654.626249:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658654.626261:0:15103:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103825280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658654.626308:0:15103:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658654.626556:0:15103:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103825280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 297us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658654.626564:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788658654.626796:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103825280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658655.133319:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658655.133352:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103825408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658655.133471:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658655.133769:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825408 00000100:00100000:1.0:1788658655.133780:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825408 00000100:00100000:1.0:1788658655.133949:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788658655.133961:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103825408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658655.134009:0:15104:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658655.134078:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103825408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658655.134085:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788658655.134177:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103825408:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788658655.261066:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788658655.261082:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658655.261131:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788658655.261141:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788658655.516929:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658655.543931:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658655.544041:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581760 00000100:00100000:3.0:1788658655.544056:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581760 00000100:00100000:3.0:1788658655.544170:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:3.0:1788658655.544194:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+12:15326:x1875544076581760:12345-192.168.202.3@tcp:35:umount.0 00000100:00080000:2.0:1788658655.544367:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788658655.544763:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00000001:00080000:3.0:1788658655.544886:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934623 00000100:00100000:3.0:1788658655.545063:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59fc9cf2-29f7-4afb-a889-1aea3676cd57+15:15326:x1875544076581760:12345-192.168.202.3@tcp:35:umount.0 Request processed in 869us (1142us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1788658655.545073:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000020:00080000:3.0:1788658655.545087:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788658655.550550:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658655.550604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658655.550818:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658655.552995:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076581888 00000100:00100000:3.0:1788658655.553016:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076581888 00000100:00100000:3.0:1788658655.553088:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076582144 00000100:00100000:3.0:1788658655.553092:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076582144 00000100:00100000:3.0:1788658655.553106:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076582016 00000100:00100000:3.0:1788658655.553109:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076582016 00000100:00100000:3.0:1788658655.553138:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1788658655.553151:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+15:2351:x1875544076581888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658655.553173:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658655.553201:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678800/0xf657f176650ebe5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b130 expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658655.553226:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658655.553320:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+14:2351:x1875544076581888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 172us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658655.553328:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1788658655.553349:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658655.553355:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+13:2351:x1875544076582144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658655.553363:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658655.553373:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed34c00/0xf657f176650ebf05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1fb expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658655.553384:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658655.553402:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:2351:x1875544076582144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 47us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658655.553408:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658655.553419:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1788658655.553446:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:2351:x1875544076582016:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658655.553454:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658655.553463:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dea00/0xf657f176650ebe64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b15a expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658655.553473:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658655.553490:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:2351:x1875544076582016:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 45us (2673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658655.553496:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658655.558839:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658655.558948:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076582272 00000100:00100000:2.0:1788658655.558961:0:15102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076582272 00000100:00100000:2.0:1788658655.559054:0:15102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1788658655.559068:0:15102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+5:2350:x1875544076582272:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:2.0:1788658655.559131:0:15102:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebe79 00000100:00080000:2.0:1788658655.559144:0:15102:0:(import.c:65:import_set_state_nolock()) ffff9e55c28f2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658655.559196:0:15102:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1788658655.559590:0:15102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59fc9cf2-29f7-4afb-a889-1aea3676cd57+2:2350:x1875544076582272:12345-192.168.202.3@tcp:9:umount.0 Request processed in 523us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658655.559599:0:15102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00080000:3.0:1788658655.559727:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788658655.565225:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658655.568418:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658655.568585:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583168 00000100:00100000:1.0:1788658655.568599:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583168 00000100:00100000:1.0:1788658655.568912:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:1.0:1788658655.568923:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+15:2350:x1875544076583168:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1788658655.568964:0:14419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebe72 00000020:00010000:1.0:1788658655.568979:0:14419:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56db3f3000: total 0 00000100:00080000:1.0:1788658655.568984:0:14419:0:(import.c:65:import_set_state_nolock()) ffff9e56eec06800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788658655.569018:0:14419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934624 00000100:00100000:1.0:1788658655.569502:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59fc9cf2-29f7-4afb-a889-1aea3676cd57+14:2350:x1875544076583168:12345-192.168.202.3@tcp:39:umount.0 Request processed in 578us (1100us total) trans 8589934625 rc 0/0 00000100:00100000:1.0:1788658655.569536:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000020:00010000:2.0:1788658655.569583:0:14407:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56db3f3000: total 0 00010000:00010000:2.0:1788658655.569589:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658655.569653:0:14407:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56db3f3000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788658655.569706:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9e56d579ca00) 00010000:00010000:2.0:1788658655.569709:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788658655.569717:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ebfde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b23a expref: 13 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569740:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69000) 00010000:00010000:2.0:1788658655.569742:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788658655.569745:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ebf3d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b209 expref: 12 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569764:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9e56c3c69400) 00010000:00010000:2.0:1788658655.569766:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788658655.569768:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec0da lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b287 expref: 11 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569780:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:2.0:1788658655.569782:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658655.569784:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfc00/0xf657f176650ebf75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b217 expref: 10 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569795:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658655.569796:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788658655.569798:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c891ac00/0xf657f176650ec05c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b264 expref: 9 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569806:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9e56c55f1b00) 00010000:00010000:2.0:1788658655.569807:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658655.569809:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec07f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b272 expref: 8 pid: 15832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569818:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56c55f1e00) 00010000:00010000:2.0:1788658655.569820:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788658655.569822:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29de400/0xf657f176650ebf21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b202 expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658655.569832:0:14407:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56db3f3000, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788658655.569839:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658655.569844:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658655.569845:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658655.916086:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658655.916232:0:15833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583296 00000100:00100000:2.0:1788658655.916246:0:15833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583296 00000100:00100000:2.0:1788658655.916375:0:15833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:2.0:1788658655.916388:0:15833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076583296:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658655.916514:0:15833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d29d269-69a5-47bf-9218-df6c9b443069+6:2351:x1875544076583296:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 129us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658655.916522:0:15833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00080000:3.0:1788658655.916685:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788658656.192610:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000001:00080000:0.0:1788658656.192633:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000020:00000080:0.0:1788658656.192651:0:5859:0:(genops.c:885:class_export_put()) final put ffff9e56db3f3000/59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000020:00000080:3.0:1788658656.192882:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db3f3000/59fc9cf2-29f7-4afb-a889-1aea3676cd57 for lustre-MDT0000 00000020:00000080:3.0:1788658656.193521:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56eec06800 for lustre-MDT0000 00010000:00010000:2.0:1788658656.541502:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658657.259026:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000020:00000080:3.0:1788658657.259035:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e55c28f3800/59fc9cf2-29f7-4afb-a889-1aea3676cd57 00000020:00000080:0.0:1788658657.259084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e55c28f3800/59fc9cf2-29f7-4afb-a889-1aea3676cd57 for lustre-OST0000 00000020:00000080:0.0:1788658657.259143:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e55c28f2800 for lustre-OST0000 00010000:00010000:2.0:1788658657.565284:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658657.625137:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658657.625196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658657.625223:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658657.625334:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583424 00000100:00100000:3.0:1788658657.625344:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583424 00000100:00100000:3.0:1788658657.625395:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583680 00000100:00100000:3.0:1788658657.625399:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583680 00000100:00100000:3.0:1788658657.625411:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583552 00000100:00100000:3.0:1788658657.625414:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583552 00000100:00100000:3.0:1788658657.625430:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658657.625439:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+12:2354:x1875544076583424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658657.625456:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658657.625479:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57021d8400/0xf657f176650ebe95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b192 expref: 12 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658657.625554:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658657.625622:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+11:2354:x1875544076583424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 182us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658657.625629:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658657.625647:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658657.625654:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+10:2354:x1875544076583680:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658657.625662:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658657.625709:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891b800/0xf657f176650ebefe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1f4 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658657.625719:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658657.625739:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+9:2354:x1875544076583680:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 86us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658657.625745:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658657.625757:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658657.625764:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+8:2354:x1875544076583552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658657.625771:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658657.625780:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678400/0xf657f176650ebe9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b1bc expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658657.625789:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658657.625806:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b9e0e608-bdd7-47a4-be53-67c24230139c+7:2354:x1875544076583552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658657.625813:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658657.637713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658657.637822:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076583936 00000100:00100000:2.0:1788658657.637834:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076583936 00000100:00100000:2.0:1788658657.637917:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:2.0:1788658657.637927:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+6:2350:x1875544076583936:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:2.0:1788658657.637969:0:15832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebeaa 00000020:00010000:2.0:1788658657.637979:0:15832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56db084800: total 0 00000100:00080000:2.0:1788658657.637984:0:15832:0:(import.c:65:import_set_state_nolock()) ffff9e56db086000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788658657.638020:0:15832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1788658657.638427:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d29d269-69a5-47bf-9218-df6c9b443069+5:2350:x1875544076583936:12345-192.168.202.3@tcp:39:umount.0 Request processed in 500us (723us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788658657.638436:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00080000:3.0:1788658657.638776:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1788658657.638848:0:14407:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56db084800: total 0 00010000:00010000:1.0:1788658657.638905:0:14407:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56db084800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788658657.638939:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c55f1c00) 00010000:00010000:1.0:1788658657.638944:0:14407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658657.638953:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56c29dfa00/0xf657f176650ebf83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b21e expref: 4 pid: 15833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658657.638979:0:14407:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56db084800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788658657.638990:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658657.638992:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658657.638994:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658657.669950:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658657.670122:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584192 00000100:00100000:0.0:1788658657.670134:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584192 00000100:00100000:0.0:1788658657.670195:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:0.0:1788658657.670206:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+7:2350:x1875544076584192:12345-192.168.202.3@tcp:251:umount.0 00000020:00000080:0.0:1788658657.670253:0:14412:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebe4f 00000020:00010000:0.0:1788658657.670260:0:14412:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56eec05000: total 0 00000100:00080000:0.0:1788658657.670265:0:14412:0:(import.c:65:import_set_state_nolock()) ffff9e56eec02800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788658657.670349:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c96c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b9e0e608-bdd7-47a4-be53-67c24230139c+3:2350:x1875544076584192:12345-192.168.202.3@tcp:251:umount.0 Request processed in 143us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658657.670357:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000020:00010000:1.0:1788658657.670796:0:16118:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56eec05000: total 0 00010000:00010000:1.0:1788658657.670840:0:16118:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56eec05000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788658657.670873:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a200/0xf657f176650ebe56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b129 expref: 2 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658657.670887:0:16118:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56eec05000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788658657.670971:0:16118:0:(genops.c:885:class_export_put()) final put ffff9e56eec05000/b9e0e608-bdd7-47a4-be53-67c24230139c 00010000:00010000:1.0:1788658657.671520:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658657.671524:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658657.671526:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788658657.676872:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56eec05000/b9e0e608-bdd7-47a4-be53-67c24230139c for MGS 00000020:00000080:3.0:1788658657.677836:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56eec02800 for MGS 00010000:00010000:3.0:1788658658.614903:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788658659.406145:0:17555:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788658659.426719:0:17555:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788658659.426780:0:17555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.426798:0:17555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.426819:0:17555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.426826:0:17555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.426842:0:17555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788658659.426847:0:17555:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788658659.426868:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658659.426872:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788658659.426877:0:17555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788658659.426901:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e56c37f5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788658659.428705:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658659.428717:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.428740:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78e00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658659.428743:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.428753:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658659.428760:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658659.428765:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658659.428768:0:14407:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788658659.428770:0:14407:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788658659.428814:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.428821:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658659.428854:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.428862:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac78e00/0xf657f176650ebb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebb85 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.428876:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658659.428878:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658659.428879:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658659.428888:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658659.428906:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103825664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658659.428969:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658659.429044:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825664 00000100:00100000:2.0:1788658659.429052:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825664 00000100:00100000:3.0:1788658659.429278:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103825536:0@lo:39:umount.0 00000100:00100000:3.0:1788658659.429320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.429390:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825536 00000100:00100000:0.0:1788658659.429394:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825536 00000100:00100000:2.0:1788658659.429430:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658659.429436:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788658659.429446:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875544103825536:12345-0@lo:39:umount.0 00000100:00100000:2.0:1788658659.429452:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+19:3305:x1875544103825664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658659.429467:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:0.0:1788658659.429473:0:14419:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebbaf 00010000:00010000:2.0:1788658659.429483:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891bc00/0xf657f176650ebb85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebb7e expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788658659.429484:0:14419:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788658659.429500:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658659.429541:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+18:3305:x1875544103825664:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658659.429548:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658659.429562:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875544103825536:12345-0@lo:39:umount.0 Request processed in 116us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658659.429622:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000020:00000080:0.0:1788658659.429634:0:14419:0:(genops.c:885:class_export_put()) final put ffff9e56c9ac6800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788658659.429733:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788658659.429762:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56c37f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788658659.429787:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103825536:0@lo:39:umount.0 00000100:00080000:1.0:1788658659.429831:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788658659.429835:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788658659.429840:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658659.430032:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c9ac6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788658659.430165:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d183b800 for lustre-MDT0000 00000100:00100000:2.0:1788658659.430549:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103825664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788658659.431114:0:17555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431127:0:17555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431135:0:17555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431142:0:17555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431253:0:17555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658659.431256:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658659.431263:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.431274:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79800 already unused, calling callback (ffffffffc1c27c20) 00010000:00010000:1.0:1788658659.431274:0:17555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658659.431281:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431285:0:17555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.431298:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431298:0:17555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431313:0:17555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658659.431316:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658659.431329:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658659.431331:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788658659.431356:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.431361:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788658659.431366:0:17555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658659.431374:0:17555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431381:0:17555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431388:0:17555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.431392:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.431395:0:17555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.431411:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79800/0xf657f176650ebae4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebaeb expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431440:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658659.431446:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431452:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c1679800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658659.431455:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658659.431458:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103825792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658659.431466:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658659.431473:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658659.431478:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788658659.431480:0:14407:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788658659.431488:0:14407:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788658659.431505:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431514:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788658659.431515:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658659.431536:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431544:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c1679800/0xf657f176650ebd76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebd7d expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431562:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658659.431566:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658659.431570:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825792 00010000:00010000:2.0:1788658659.431573:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c29de200 already unused, calling callback (ffffffffc1c27c20) 00000100:00100000:0.0:1788658659.431577:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825792 10000000:00010000:2.0:1788658659.431578:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431587:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658659.431594:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658659.431599:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788658659.431601:0:14407:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788658659.431613:0:14407:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658659.431619:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788658659.431620:0:14407:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658659.431628:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658659.431631:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+18:3305:x1875544103825792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.431647:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658659.431683:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658659.431686:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658659.431689:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658659.431694:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679200/0xf657f176650ebaeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebae4 expref: 18 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658659.431700:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103825920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.431707:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658659.431734:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.431752:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+17:3305:x1875544103825792:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658659.431761:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788658659.431761:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658659.431771:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103826048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658659.431794:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103825920 00000100:00100000:2.0:1788658659.431799:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.431800:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103825920 00000100:00100000:0.0:1788658659.431823:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826048 00000100:00100000:0.0:1788658659.431826:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826048 00000100:00100000:2.0:1788658659.431829:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658659.431839:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+18:3306:x1875544103825920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658659.431848:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658659.431859:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29df600/0xf657f176650ebd7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebd76 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658659.431867:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103825792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658659.431871:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658659.431901:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+17:3306:x1875544103825920:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658659.431907:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788658659.431912:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103825920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658659.431925:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658659.431933:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56de4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+16:3306:x1875544103826048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658659.431941:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658659.431949:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a400/0xf657f176650ebef7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebef0 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658659.431956:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788658659.431987:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658659.431990:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658659.431994:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658659.431994:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56de4ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7221c739-be00-4743-a572-f61de58b82dc+15:3306:x1875544103826048:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658659.432002:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788658659.432142:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103826048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.432214:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658659.432247:0:17555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658659.432253:0:17555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c29de200/0xf657f176650ebef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebef7 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658659.432263:0:17555:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788658659.432275:0:17555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.432283:0:17555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.432289:0:17555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.432295:0:17555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658659.432312:0:17555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788658659.432315:0:17555:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788658659.432317:0:17555:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788658659.432341:0:17555:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788658659.432345:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788658659.432349:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658659.432354:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788658659.432358:0:17555:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e55c2b99800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658659.432364:0:17555:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9e56db3f1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658659.432369:0:17555:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9e56db084800 9d29d269-69a5-47bf-9218-df6c9b443069 192.168.202.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934597 stale:0 00000020:00080000:1.0:1788658659.432374:0:17555:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9e56c8914d40) has exports, disconnecting them 00000020:00080000:1.0:1788658659.432378:0:17555:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e55c2b99800), last request at 1788658654 00000020:00000080:1.0:1788658659.432383:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebd68 00000100:00080000:1.0:1788658659.432397:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788658659.432429:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658659.432435:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.432441:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79c00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658659.432444:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.432452:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658659.432458:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658659.432464:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658659.432467:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788658659.432469:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788658659.432487:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.432493:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658659.432500:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658659.432525:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658659.432533:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79c00/0xf657f176650ebad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebadd expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788658659.432538:0:17555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e55c2b99800): rc 0 00000020:00000080:1.0:1788658659.432542:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e55c2b99800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788658659.432556:0:17555:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9e56db3f1000), last request at 1788658654 00010000:00010000:3.0:1788658659.432558:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658659.432561:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658659.432564:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788658659.432569:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebc34 00000020:00000080:3.0:1788658659.432576:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e55c2b99800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1788658659.432579:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e56db3f5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788658659.432594:0:17555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56db3f1000): rc 0 00000020:00000080:1.0:1788658659.432596:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56db3f1000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788658659.432605:0:17555:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbdf244b53ae0 00000020:00000080:3.0:1788658659.432611:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e55c2b9e800 for lustre-MDT0000 00000020:00000080:3.0:1788658659.432617:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db3f1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788658659.432623:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788658659.432627:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000020:00000080:3.0:1788658659.432640:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56db3f5800 for lustre-MDT0000 00000004:00080000:1.0:1788658659.432641:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658659.432714:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658659.432726:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103826176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.432732:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658659.432754:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.432822:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826176 00000100:00100000:0.0:1788658659.432827:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826176 00000100:00100000:0.0:1788658659.432868:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788658659.432877:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+15:3305:x1875544103826176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.432887:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658659.432898:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679a00/0xf657f176650ebadd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebad6 expref: 15 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658659.432910:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1788658659.432924:0:17555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788658659.432939:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788658659.432945:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7221c739-be00-4743-a572-f61de58b82dc+14:3305:x1875544103826176:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658659.432954:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788658659.432955:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788658659.432959:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788658659.432970:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658659.432977:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103826304:0@lo:9:umount.0 00000100:00100000:0.0:1788658659.433008:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.433045:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826304 00000100:00080000:1.0:1788658659.433047:0:17555:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788658659.433049:0:15101:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826304 00000100:00080000:1.0:1788658659.433058:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788658659.433098:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000020:00080000:1.0:1788658659.433100:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e56c8914d40) has no exports 00000100:00100000:0.0:1788658659.433108:0:15101:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875544103826304:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788658659.433127:0:15101:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebc50 00000100:00080000:0.0:1788658659.433134:0:15101:0:(import.c:65:import_set_state_nolock()) ffff9e5700518000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658659.433167:0:15101:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788658659.433459:0:15101:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875544103826304:12345-0@lo:9:umount.0 Request processed in 354us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658659.433466:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788658659.433481:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658659.433551:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103826432:0@lo:9:umount.0 00000100:00100000:0.0:1788658659.433583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658659.433609:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e5700dc6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658659.433617:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658659.433619:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658659.433621:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103826304:0@lo:9:umount.0 00000100:00100000:0.0:1788658659.433747:0:15581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826432 00000100:00100000:0.0:1788658659.433751:0:15581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826432 00000100:00100000:0.0:1788658659.433816:0:15581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788658659.433822:0:15581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875544103826432:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788658659.433835:0:15581:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebd84 00000100:00080000:0.0:1788658659.433841:0:15581:0:(import.c:65:import_set_state_nolock()) ffff9e56fefaa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788658659.433857:0:15581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1788658659.434031:0:15581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1875544103826432:12345-0@lo:9:umount.0 Request processed in 208us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658659.434037:0:15581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788658659.434061:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183a000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788658659.434068:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788658659.434070:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788658659.434073:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103826432:0@lo:9:umount.0 00000100:00100000:0.0:1788658659.434096:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7221c739-be00-4743-a572-f61de58b82dc:3305:1875544103826176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658659.434110:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658659.434179:0:14415:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788658659.437308:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788658659.444887:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9e56c8914d40) has no exports 00000020:00000080:1.0:1788658659.520248:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb31 00000020:00000080:1.0:1788658659.520265:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56f446b800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788658659.520315:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788658659.520387:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f446b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788658659.520411:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658659.520420:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658659.520425:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9e56c83e3380) has no exports 00000020:00000080:0.0:1788658659.520879:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb2a 00000020:00000080:0.0:1788658659.520886:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56fb3ad800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658659.520951:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658659.520971:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788658659.520974:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56ff016800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788658659.520977:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff016800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788658659.520981:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788658659.521116:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fb3ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788658659.681807:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658659.741188:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103826560:0@lo:400:kworker.0 00000100:00100000:1.0:1788658659.741253:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658659.741390:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658659.741399:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103826688:0@lo:400:kworker.0 00000100:00100000:2.0:1788658659.741433:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658659.741464:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826560 00000100:00100000:2.0:1788658659.741470:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826560 00000100:00100000:2.0:1788658659.741511:0:15832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826688 00000100:00100000:2.0:1788658659.741514:0:15832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826688 00000100:00100000:2.0:1788658659.741528:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658659.741535:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875544103826560:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788658659.741543:0:15832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788658659.741575:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1875544103826560:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788658659.741582:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658659.741597:0:15832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658659.741601:0:15832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875544103826688:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788658659.741605:0:15832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788658659.741622:0:15832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875544103826688:12345-0@lo:400:kworker.0 Request processed in 21us (189us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788658659.741627:0:15832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788658659.741660:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788658659.741710:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788658659.741715:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658659.742802:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658659.742807:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e56eec07800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788658659.742811:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788658659.742815:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9e56eec07800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658659.742820:0:3305:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1788658659.742834:0:3305:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e56eec07800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658659.742876:0:3305:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57008ff100 x1875544103826816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658659.742896:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875544103826560:0@lo:400:kworker.0 00000100:00100000:0.0:1788658659.742921:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103826816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788658659.742960:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658659.743000:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826816 00000100:00100000:0.0:1788658659.743005:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826816 00000100:00100000:0.0:1788658659.743031:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788658659.743037:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103826816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788658659.743052:0:14419:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788658659.768192:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658659.768203:0:3307:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 504 00000100:00080000:2.0:1788658659.768212:0:3307:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e55c2b9e000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658659.768269:0:3307:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd9500 x1875544103826944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658659.768300:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103826688:0@lo:400:kworker.0 00000100:00100000:2.0:1788658659.768342:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103826944:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788658659.768412:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658659.768647:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103826944 00000100:00100000:2.0:1788658659.768655:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103826944 00000100:00100000:2.0:1788658659.768726:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788658659.768734:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103826944:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788658659.768750:0:14418:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788658659.768795:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103826944:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 60us (381us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658659.768802:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788658659.768842:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658659.768847:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788658659.768850:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103826944:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788658659.789388:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103826816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 46342us (46420us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788658659.789402:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788658659.789507:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56eec07800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788658659.789513:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788658659.789517:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103826816:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1788658659.791801:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658659.791808:0:7647:0:(genops.c:885:class_export_put()) final put ffff9e56fefaf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658659.791867:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fefaf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788658659.791915:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56fefaa800 for lustre-OST0001 00010000:00010000:0.0:1788658660.700912:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788658661.372312:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9d29d269-69a5-47bf-9218-df6c9b443069 00000001:00080000:3.0:1788658661.372337:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1788658661.372343:0:5859:0:(genops.c:885:class_export_put()) final put ffff9e56db084800/9d29d269-69a5-47bf-9218-df6c9b443069 00000020:00000080:0.0:1788658661.372444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db084800/9d29d269-69a5-47bf-9218-df6c9b443069 for lustre-MDT0000 00000020:00000080:0.0:1788658661.372509:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56db086000 for lustre-MDT0000 00000020:01000000:0.0:1788658661.533151:0:17555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c550c660 - data ffff9e56d1318e58/ffff9e55c286ec00 00000020:01000000:0.0:1788658661.533294:0:17555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c4c21780 - data ffff9e56ffaf0ca8/ffff9e56e6f11800 00000001:00000004:0.0:1788658661.544449:0:17555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00080000:2.0:1788658661.647076:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658661.647098:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:2.0:1788658661.647123:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658661.647126:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658661.647679:0:14440:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658661.647686:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788658661.647699:0:14440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788658661.649110:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658661.649116:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788658661.649138:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658661.649141:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788658661.649429:0:14442:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788658661.649435:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788658661.649445:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788658661.751833:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebaf9 00000020:00000080:2.0:1788658661.751849:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d1838000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658661.752435:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d1838000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788658661.753196:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb0e 00000020:00000080:2.0:1788658661.753206:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c2a94800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788658661.753261:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788658661.753268:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658661.753278:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788658661.753283:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9e56c89119c0) has no exports 00000004:01000000:2.0:1788658661.753466:0:17555:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788658661.753477:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb5b 00000020:00000080:2.0:1788658661.753481:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56f44c5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658661.757165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c2a94800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788658661.758853:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788658661.758878:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658661.758890:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658661.758895:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9e56e6ee19c0) has no exports 00000020:00000080:2.0:1788658661.758906:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb54 00000020:00000080:2.0:1788658661.758916:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d183c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658661.761405:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56f44c5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788658661.762194:0:17555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788658661.762201:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788658661.762205:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788658661.762212:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658661.762215:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788658661.762329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d183c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788658661.765365:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658661.765383:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658661.765393:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb46 00000020:00000080:2.0:1788658661.765403:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e5700dc5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658661.766854:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d183a000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788658661.766882:0:37:0:(genops.c:885:class_export_put()) final put ffff9e5700dc2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658661.766885:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700dc2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788658661.766893:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788658661.769632:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788658661.769646:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658661.769658:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788658661.769691:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9e56c8910000) has no exports 00000020:00000080:2.0:1788658661.769724:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb3f 00000020:00000080:2.0:1788658661.769733:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e5700dc1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788658661.770623:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700dc5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788658661.777789:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e5700dc1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788658661.778462:0:17555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788658661.778468:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788658661.778473:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:2.0:1788658661.778480:0:17555:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788658661.778482:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788658661.778565:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658661.778576:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658661.778604:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658661.778607:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658661.778613:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d183f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788658661.778616:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d183f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788658661.778626:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788658661.779159:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb15 00000020:00000080:2.0:1788658661.779168:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c2a93800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788658661.779323:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5700dc6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788658661.779331:0:37:0:(genops.c:885:class_export_put()) final put ffff9e56d183d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658661.779333:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d183d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788658661.779338:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788658661.780851:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788658661.780868:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658661.780889:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788658661.780894:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9e56c8913380) has no exports 00000020:00000080:2.0:1788658661.780929:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658661.780934:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788658661.780952:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb1c 00000020:00000080:2.0:1788658661.780958:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d6ebd000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788658661.784863:0:17555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56d00a1000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788658661.784885:0:17555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56d00a1000 3 00000020:01000004:2.0:1788658661.784890:0:17555:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56d00a1000 from lustre-MDT0000 00000020:00000080:2.0:1788658661.784938:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658661.786380:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788658661.786388:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d1839000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788658661.786393:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d1839000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788658661.786409:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788658661.786476:0:17555:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788658661.786484:0:17555:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788658661.786488:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788658661.786493:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658661.786497:0:17555:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788658661.786504:0:17555:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9e56e33b1800 7221c739-be00-4743-a572-f61de58b82dc 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658661.786511:0:17555:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9e56c83e19c0) has exports, disconnecting them 00000020:00080000:2.0:1788658661.786516:0:17555:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9e56e33b1800), last request at 1788658582 00000020:00000080:2.0:1788658661.786532:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebac1 00000020:00010000:2.0:1788658661.786539:0:17555:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9e56e33b1800: total 2 00000100:00080000:2.0:1788658661.786544:0:17555:0:(import.c:65:import_set_state_nolock()) ffff9e56d16af800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788658661.786565:0:17555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56e33b1800): rc 0 00000020:00080000:2.0:1788658661.786570:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9e56c83e19c0) has no exports 00000100:00100000:2.0:1788658661.786647:0:14413:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9e56c64e5800:14413] 1 exiting: rc = 0 00000020:00000080:0.0:1788658661.787266:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c2a93800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788658661.787274:0:37:0:(genops.c:885:class_export_put()) final put ffff9e56d183a800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788658661.787276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d183a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788658661.787289:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:0.0:1788658661.787317:0:14412:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9e56c95cd400:14412] 0 exiting: rc = 1 00000020:00000080:0.0:1788658661.787489:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d6ebd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788658661.787883:0:14407:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9e56e33b1800: total 0 00010000:00010000:0.0:1788658661.787888:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658661.787912:0:14407:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9e56e33b1800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788658661.787963:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1679600/0xf657f176650ebc1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebc18 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.787983:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007eee00/0xf657f176650ebacf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebac8 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.787994:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c891a600/0xf657f176650ebee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebee2 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788004:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dec00/0xf657f176650ebedb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebed4 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788019:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79600/0xf657f176650ebd29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebd22 expref: 5 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788028:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c1678000/0xf657f176650ebbe7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebbe0 expref: 4 pid: 14412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788041:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56c29dee00/0xf657f176650ebd53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebd4c expref: 3 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788050:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ef200/0xf657f176650ebbf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf657f176650ebbee expref: 2 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658661.788060:0:14407:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9e56e33b1800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788658661.788072:0:14407:0:(genops.c:885:class_export_put()) final put ffff9e56e33b1800/7221c739-be00-4743-a572-f61de58b82dc 00010000:00010000:0.0:1788658661.788092:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658661.788094:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658661.788103:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788658661.788325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e33b1800/7221c739-be00-4743-a572-f61de58b82dc for MGS 00000020:00000080:2.0:1788658661.788352:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56d16af800 for MGS 00000100:00100000:1.0:1788658661.788543:0:14414:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9e56c95cd600:14414] 2 exiting: rc = 0 00000100:00100000:2.0:1788658661.792814:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792824:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792830:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792835:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792840:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792846:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792851:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792858:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792864:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792881:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792887:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792893:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792916:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792921:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792927:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.792934:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793080:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793090:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793096:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793101:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793107:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793112:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793117:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793122:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793127:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793133:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793139:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793144:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793149:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793155:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793161:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793166:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793172:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793178:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793185:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793190:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793195:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793200:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793205:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793210:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793216:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793222:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793642:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793653:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793658:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793700:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793708:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793726:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793732:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793737:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793742:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793747:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793753:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793758:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793764:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793770:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793775:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793781:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793786:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793792:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793798:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793803:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793809:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.793815:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788658661.794745:0:17555:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788658661.794750:0:17555:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788658661.800531:0:17555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c550c5a0 - data ffff9e56ffcb7af8/ffff9e55c286dc00 00000020:01000000:0.0:1788658661.804182:0:17555:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56c5d95ae0 - data ffff9e56d126c1b0/ffff9e56c6af2800 00000020:00000080:1.0:1788658661.805323:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebaa5 00000020:00000080:1.0:1788658661.805344:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56d1659800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788658661.805401:0:17555:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56d00a1000 from MGS, refs=2 00000020:01000004:1.0:1788658661.805407:0:17555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56d00a1000 2 00000020:01000004:1.0:1788658661.805412:0:17555:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56d00a1000 from MGS 00000020:00000080:1.0:1788658661.805449:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788658661.805461:0:17555:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788658661.805464:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c3dd6800/MGS 00000020:00000080:1.0:1788658661.805467:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c3dd6800/MGS for MGS 00000020:01000000:1.0:1788658661.805483:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788658661.805552:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788658661.805556:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788658661.805563:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788658661.805571:0:17555:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9e56c37f5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788658661.805578:0:17555:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff9e56c6448000) has exports, disconnecting them 00000020:00080000:1.0:1788658661.805584:0:17555:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9e56c37f5000), last request at 1788658583 00000020:00000080:1.0:1788658661.805588:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebb93 00000020:00080000:1.0:1788658661.805600:0:17555:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56c37f5000): rc 0 00000020:00000080:1.0:1788658661.805605:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c37f5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788658661.808626:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56d1659800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658661.811193:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c37f5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788658661.811998:0:17555:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788658661.812004:0:17555:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788658661.812008:0:17555:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788658661.812015:0:17555:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788658661.812129:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56c37f5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788658661.812210:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658661.812221:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788658661.812227:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e570051a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788658661.812230:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788658661.812237:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788658661.812301:0:17555:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56d00a1000 1 00000020:00000080:0.0:1788658661.812307:0:17555:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650eba97 00000020:00000080:0.0:1788658661.812314:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c3dd0000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788658661.812330:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788658661.812334:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658661.812338:0:17555:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788658661.812342:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9e56c83e0000) has no exports 00000020:00000080:2.0:1788658661.812414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c3dd0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788658661.836968:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658661.836984:0:17555:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788658661.836990:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56c61c5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788658661.836996:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56c61c5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788658661.837007:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788658661.837176:0:17555:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e56c61c6000 00000020:01000000:0.0:1788658661.837212:0:17555:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788658661.837217:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788658661.837222:0:17555:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658661.837237:0:17555:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9e56fb3b99c0) has no exports 00000100:00100000:2.0:1788658661.839320:0:14418:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9e56c944b200:14418] 0 exiting: rc = 1 00000100:00100000:2.0:1788658661.839445:0:15833:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9e56ff071c00:15833] 4 exiting: rc = 0 00000100:00100000:0.0:1788658661.839732:0:14419:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9e56c944aa00:14419] 1 exiting: rc = 0 00000100:00100000:3.0:1788658661.839873:0:14420:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9e56c944bc00:14420] 2 exiting: rc = 0 00000100:00100000:3.0:1788658661.839937:0:15832:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9e56deaf2e00:15832] 3 exiting: rc = 0 00000100:00100000:0.0:1788658661.840311:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840319:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840324:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840330:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840336:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840342:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840350:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840356:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840361:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840367:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840372:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840377:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840383:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840388:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840396:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840402:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840408:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840413:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840418:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840424:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840429:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840436:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840441:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840447:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840452:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840458:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840467:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840475:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840481:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840486:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840491:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840500:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840505:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840521:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840527:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840534:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840539:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840547:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840553:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840559:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840564:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840570:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840575:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840580:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840588:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840593:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840598:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840603:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840609:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840615:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840620:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840626:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840631:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840947:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840958:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840964:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840971:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840978:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840984:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840990:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.840996:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.841002:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.841007:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.841013:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.844191:0:14422:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9e56efabb200:14422] 1 exiting: rc = 0 00000100:00100000:3.0:1788658661.844712:0:14421:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9e56efaba200:14421] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.845311:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845321:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845328:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845345:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845356:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845362:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845367:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845372:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845377:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845382:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845387:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845392:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845397:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845403:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845408:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845413:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845417:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845422:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845427:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845433:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845438:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845444:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845450:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845456:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845462:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845467:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845471:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845477:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845482:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845487:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845492:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845497:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845502:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845506:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845511:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845516:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845520:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845526:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845540:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845545:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845550:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845555:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845560:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845566:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845571:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845577:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845582:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845589:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845594:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845600:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845605:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845611:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845617:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845622:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845628:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845633:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845638:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845644:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845649:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845654:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845659:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845696:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845703:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.845708:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846200:0:14424:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9e56c5dc9800:14424] 1 exiting: rc = 0 00000100:00100000:2.0:1788658661.846487:0:14423:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9e56c5dc8600:14423] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.846571:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846579:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846585:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846593:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846601:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846608:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846615:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846622:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846639:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846648:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846654:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846661:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846724:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846730:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846737:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846761:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846768:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846775:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846782:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846788:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846795:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846801:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846807:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846813:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846818:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846824:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846830:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846851:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846859:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846868:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846885:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846893:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846898:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846904:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846910:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846916:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846922:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846927:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846934:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846955:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846964:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846971:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.846978:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847014:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847038:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847050:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847075:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847082:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847088:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847095:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847101:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847132:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847141:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847148:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847154:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847160:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847165:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847171:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847177:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847183:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847200:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847207:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847213:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.847219:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.856716:0:14425:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9e56ff561a00:14425] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.856909:0:14426:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9e56ff560600:14426] 1 exiting: rc = 0 00000100:00100000:2.0:1788658661.857417:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857426:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857432:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857438:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857443:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857448:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857453:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857459:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857465:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857485:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857490:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857496:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857502:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857508:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857513:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857518:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857523:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857529:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857534:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857539:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857545:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857549:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857556:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857561:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857566:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857571:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857577:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857583:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857589:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857594:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857600:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857606:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857611:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857617:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857623:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857631:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857637:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857643:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857649:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857655:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857660:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857784:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857790:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857797:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857810:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857815:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857820:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857825:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857830:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857836:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857841:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857846:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857851:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857857:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857864:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857870:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857875:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857892:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857898:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857903:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857909:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857914:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857919:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658661.857926:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858728:0:14427:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9e56c8886e00:14427] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.858825:0:14428:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9e56c8887000:14428] 1 exiting: rc = 0 00000100:00100000:0.0:1788658661.858874:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858895:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858900:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858905:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858911:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858917:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858923:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858928:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858933:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858939:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858946:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858963:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858969:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858975:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858980:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858986:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858991:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.858996:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859001:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859005:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859009:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859014:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859019:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859024:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859029:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859035:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859040:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859046:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859051:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859057:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859061:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859066:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859071:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859076:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859082:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859087:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859092:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859098:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859104:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859110:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859116:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859121:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859127:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859132:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859137:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859142:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859155:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859161:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859166:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859171:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859176:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859181:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859186:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859191:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859196:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859201:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859206:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859211:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859217:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859222:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859227:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859232:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859238:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859243:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.859552:0:14430:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9e56c6404a00:14430] 1 exiting: rc = 0 00000100:00100000:3.0:1788658661.859716:0:14429:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9e56c6404800:14429] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.860018:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860025:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860030:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860035:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860040:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860046:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860051:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860056:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860060:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860065:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860070:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860074:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860080:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860084:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860089:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860095:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860109:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860114:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860120:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860126:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860131:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860136:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860142:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860148:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860152:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860158:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860163:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860168:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860173:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860178:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860183:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860188:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860194:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860200:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860205:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860210:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860215:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860221:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860227:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860232:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860238:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860244:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860249:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860255:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860260:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860265:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860271:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860276:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860282:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860288:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860293:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860306:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860311:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860316:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860323:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860329:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860334:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860339:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860345:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860351:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860356:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860361:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860366:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860371:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.860850:0:14431:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9e56c2db7a00:14431] 0 exiting: rc = 1 00000100:00100000:0.0:1788658661.861049:0:14432:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9e56e3005600:14432] 1 exiting: rc = 0 00000100:00100000:0.0:1788658661.862608:0:14433:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9e56e3005e00:14433] 2 exiting: rc = 0 00000100:00100000:0.0:1788658661.863216:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863224:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863229:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863234:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863239:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863245:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863250:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863257:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863263:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863272:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863278:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863284:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863292:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863297:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863304:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863324:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863333:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863340:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863347:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863367:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863375:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863381:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863387:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863397:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863404:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863409:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863415:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863421:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863430:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863436:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863441:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863447:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863453:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863459:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863465:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863471:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863476:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863482:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863489:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863510:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863519:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863525:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863530:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863537:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863544:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863549:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863556:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863562:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863568:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863573:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863578:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863584:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863590:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863595:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863610:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863617:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863623:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863630:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863636:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863643:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863648:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863655:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863660:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658661.863694:0:17555:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788658661.868586:0:17555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658661.868598:0:17555:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788658661.868604:0:17555:0:(genops.c:885:class_export_put()) final put ffff9e56ff010800/MDS_uuid 00000020:00000080:0.0:1788658661.868608:0:17555:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff010800/MDS_uuid for MDS 00000020:01000000:0.0:1788658661.868615:0:17555:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788658661.868761:0:17555:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788658662.193130:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658662.396386:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658662.396397:0:6712:0:(genops.c:885:class_export_put()) final put ffff9e570051b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788658662.396432:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9e570051b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788658662.396481:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e5700518000 for lustre-OST0000 00010000:00010000:0.0:1788658663.197328:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658664.221197:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788658664.840917:0:17710:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788658664.859027:0:17710:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788658664.859085:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.859103:0:17710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.859111:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.859118:0:17710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.859173:0:17710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658664.859180:0:17710:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788658664.859206:0:17710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658664.859211:0:17710:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658664.859217:0:17710:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658664.859224:0:17710:0:(import.c:65:import_set_state_nolock()) ffff9e56eec07800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788658664.859229:0:17710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658664.859231:0:17710:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788658664.859234:0:17710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788658664.860019:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658664.860028:0:16118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.860037:0:16118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658664.860040:0:16118:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.860050:0:16118:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658664.860058:0:16118:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658664.860076:0:16118:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658664.860079:0:16118:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788658664.860082:0:16118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788658664.860118:0:16118:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.861178:0:16118:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658664.861217:0:16118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.861226:0:16118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ebc18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebc1f expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658664.861245:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658664.861247:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658664.861249:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658664.861586:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658664.861606:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103827072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658664.862161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658664.862411:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827072 00000100:00100000:0.0:1788658664.862420:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827072 00000100:00100000:0.0:1788658664.862465:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658664.862473:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1875544103827072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788658664.862480:0:14405:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658664 with bad export cookie 17750921947107998401 00000100:00080000:3.0:1788658664.865781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788658664.865793:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788658664.865797:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658664.865809:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:3.0:1788658664.865833:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788658664.865842:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e55c2b9e000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658664.865884:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56eec5e300 x1875544103827200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658664.866074:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103827200:0@lo:38:kworker.0 00000400:00000100:3.0:1788658664.866130:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875544103827200 offset 0 length 520: 4 00010000:00010000:2.0:1788658664.867240:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867258:0:17710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867267:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867274:0:17710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867299:0:17710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658664.867307:0:17710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867314:0:17710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867350:0:17710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867356:0:17710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658664.867374:0:17710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788658664.867378:0:17710:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788658664.867408:0:17710:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788658664.867412:0:17710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788658664.867417:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658664.867424:0:17710:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658664.867428:0:17710:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e56c56c3380) has no exports 00000020:00080000:2.0:1788658664.867458:0:17710:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9e56c56c3380) has no exports 00010000:00010000:3.0:1788658664.868215:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658664.868226:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868235:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891b000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658664.868240:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868251:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658664.868259:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658664.868266:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658664.868269:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788658664.868271:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788658664.868314:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868321:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658664.868353:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868375:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891b000/0xf657f176650ebbee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebbf5 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868393:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658664.868397:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868403:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a800 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658664.868405:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868412:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658664.868418:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658664.868423:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788658664.868425:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788658664.868427:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788658664.868441:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868447:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658664.868453:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868460:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891a800/0xf657f176650ebee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf657f176650ebee9 expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658664.868479:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658664.868481:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658664.868483:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658664.868700:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103827328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658664.868791:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658664.868845:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658664.868852:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103827456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658664.868874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658664.869115:0:14404:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788658664.869124:0:14404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788658664.869146:0:14406:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788658664.869162:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827328 00000100:00100000:3.0:1788658664.869170:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827328 00000100:00100000:3.0:1788658664.869199:0:14406:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788658664.869203:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827456 00000100:00100000:3.0:1788658664.869205:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827456 00000100:00100000:3.0:1788658664.870887:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658664.870901:0:17711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1875544103827328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788658664.870908:0:17711:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658664 with bad export cookie 17750921947107998401 00000100:00100000:3.0:1788658664.871107:0:17711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1875544103827328:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (2314us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788658664.871115:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658664.871135:0:17711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658664.871139:0:17711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1875544103827456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788658664.871143:0:17711:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788658664 with bad export cookie 17750921947107998401 00000100:00100000:3.0:1788658664.871433:0:17711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1875544103827456:12345-0@lo:103:ldlm_bl.0 Request processed in 291us (2557us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788658664.871440:0:17711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788658664.871551:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658664.871556:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e56e33b3800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788658664.871572:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:2.0:1788658664.874729:0:17710:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56facb75a0 - data ffff9e56ffdaa870/ffff9e55c23b2800 00000020:01000000:2.0:1788658664.874907:0:17710:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56facb7240 - data ffff9e56ffccd1b0/ffff9e56eed45400 00010000:00010000:0.0:1788658664.877904:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658664.878009:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3306:x1875544103827072:12345-0@lo:103:ldlm_bl.0 Request processed in 15530us (15854us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788658664.878021:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788658664.878380:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788658664.896576:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.103@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788658664.896585:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788658664.896597:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e57008fdf80 x1875544103827072/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658680 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658664.896614:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56eec5d880 x1875544103827328/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658680 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658664.896623:0:3304:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56eec5ed80 x1875544103827456/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788658680 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788658664.896632:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788658664.896635:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788658664.896636:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788658664.896777:0:3306:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9e56e33b3800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788658664.896807:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7221c739-be00-4743-a572-f61de58b82dc:3306:1875544103827072:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788658664.896960:0:3304:0:(import.c:65:import_set_state_nolock()) ffff9e56e33b3800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658664.896967:0:3304:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:1.0:1788658664.896976:0:3304:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import ffff9e56e33b3800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658664.897012:0:3304:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57007e1c00 x1875544103827584/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658664.897058:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103827328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788658664.897075:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7221c739-be00-4743-a572-f61de58b82dc:3304:1875544103827456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658664.897153:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7221c739-be00-4743-a572-f61de58b82dc:3303:1875544103827584:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788658664.897220:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875544103827584 offset 0 length 520: 4 00100000:10000000:2.0:1788658664.906173:0:17710:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788658664.927316:0:17710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebc03 00000020:00000080:2.0:1788658664.927328:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56db082000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788658664.927435:0:17710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56e5c8d800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788658664.927439:0:17710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56e5c8d800 2 00000020:01000004:2.0:1788658664.927443:0:17710:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56e5c8d800 from lustre-OST0000 00000020:00000080:2.0:1788658664.927476:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788658664.927487:0:17710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788658664.927490:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56db084000/lustre-OST0000_UUID 00000020:00000080:2.0:1788658664.927493:0:17710:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db084000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788658664.927501:0:17710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788658664.927547:0:17710:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788658664.927551:0:17710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788658664.927568:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658664.927573:0:17710:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788658664.927581:0:17710:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9e56eed4a000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788658664.927587:0:17710:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9e56fb3bb380) has exports, disconnecting them 00000020:00080000:2.0:1788658664.927593:0:17710:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9e56eed4a000), last request at 1788658598 00000020:00000080:2.0:1788658664.927597:0:17710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebc2d 00000020:00080000:2.0:1788658664.927606:0:17710:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e56eed4a000): rc 0 00000020:00000080:2.0:1788658664.927611:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56eed4a000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788658664.927867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56db082000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788658664.931414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56eed4a000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788658664.932723:0:17710:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788658664.932731:0:17710:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658664.932735:0:17710:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788658664.932742:0:17710:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788658664.932768:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56eec07800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788658664.932975:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658664.932985:0:17710:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788658664.932990:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56eec01800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788658664.932994:0:17710:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56eec01800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788658664.933000:0:17710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788658664.933058:0:17710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56e5c8d800 1 00000020:00000080:3.0:1788658664.933066:0:17710:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebbd2 00000020:00000080:3.0:1788658664.933072:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56fefa9000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788658664.933080:0:17710:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788658664.933088:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fefa9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788658664.933098:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658664.933103:0:17710:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658664.933107:0:17710:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9e56fb3b8000) has no exports 00000020:00000080:3.0:1788658664.945055:0:17710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658664.945075:0:17710:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788658664.945081:0:17710:0:(genops.c:885:class_export_put()) final put ffff9e56e5c8f000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788658664.945087:0:17710:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e5c8f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788658664.945095:0:17710:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788658664.945268:0:17710:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e56e5c8c000 00000020:02000400:3.0:1788658664.945336:0:17710:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788658665.245640:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658666.268774:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658667.294632:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658668.323754:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788658668.352630:0:17860:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788658668.365353:0:17860:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788658668.365469:0:17860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.365499:0:17860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.365508:0:17860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.365515:0:17860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.365534:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788658668.365540:0:17860:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788658668.365570:0:17860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658668.365589:0:17860:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56eec5e300 x1875544103827200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658679 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658668.365605:0:17860:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788658668.365613:0:17860:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788658668.365623:0:17860:0:(import.c:65:import_set_state_nolock()) ffff9e55c2b9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788658668.365650:0:17860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788658668.365655:0:17860:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e56eec5e300 x1875544103827200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788658679 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658668.365680:0:17860:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788658668.365685:0:17860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:3.0:1788658668.366812:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658668.366826:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658668.366839:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891a000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658668.366844:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658668.366856:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658668.366864:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658668.366871:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658668.366873:0:14408:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788658668.366877:0:14408:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788658668.366897:0:14408:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56e33b3800 00010000:00010000:3.0:1788658668.366901:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658668.366908:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891a000/0xf657f176650ebd4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebd53 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658668.366921:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658668.366923:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658668.366925:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658668.367045:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103827200:0@lo:38:kworker.0 00010000:00010000:2.0:1788658668.370386:0:17860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370417:0:17860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370427:0:17860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370435:0:17860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370529:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658668.370540:0:17860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370547:0:17860:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370554:0:17860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658668.370560:0:17860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370761:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658668.370773:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370782:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56c891be00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658668.370787:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370798:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658668.370806:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658668.370813:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788658668.370815:0:14407:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788658668.370831:0:14407:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56e33b3800 00010000:00010000:0.0:1788658668.370836:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370843:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891be00/0xf657f176650ebd22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebd29 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370864:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658668.370868:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370874:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658668.370877:0:14407:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370898:0:14407:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658668.370904:0:14407:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658668.370910:0:14407:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788658668.370912:0:14407:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788658668.370917:0:14407:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56e33b3800 00010000:00010000:0.0:1788658668.370920:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658668.370937:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658668.370939:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658668.370942:0:14407:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658668.371092:0:17860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658668.371098:0:17860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56eed35200/0xf657f176650ebed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebedb expref: -99 pid: 14416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658668.371118:0:17860:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788658668.371123:0:17860:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788658668.371126:0:17860:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788658668.371257:0:17860:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788658668.371264:0:17860:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788658668.371272:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658668.371280:0:17860:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788658668.371286:0:17860:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9e56c64499c0) has no exports 00000020:00080000:2.0:1788658668.371328:0:17860:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9e56c64499c0) has no exports 00010000:00010000:0.0:1788658668.376866:0:16118:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788658668.377832:0:17860:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56fb39f8a0 - data ffff9e56f96fe948/ffff9e55c1932c00 00000020:01000000:2.0:1788658668.378134:0:17860:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9e56fb39fb40 - data ffff9e56f976d288/ffff9e55c1949c00 00100000:10000000:3.0:1788658668.388040:0:17860:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788658668.421591:0:17860:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebd37 00000020:00000080:3.0:1788658668.421606:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e55c28f7800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788658668.421630:0:17860:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56eec4f000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788658668.421635:0:17860:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56eec4f000 2 00000020:01000004:3.0:1788658668.421638:0:17860:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9e56eec4f000 from lustre-OST0001 00000020:00000080:3.0:1788658668.421694:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658668.421709:0:17860:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788658668.421713:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e55c28f7000/lustre-OST0001_UUID 00000020:00000080:3.0:1788658668.421717:0:17860:0:(genops.c:844:class_export_destroy()) destroying export ffff9e55c28f7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788658668.421726:0:17860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788658668.421882:0:17860:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7221c739-be00-4743-a572-f61de58b82dc->MGS 00010000:00010000:3.0:1788658668.421907:0:17860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658668.421924:0:17860:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658668.421932:0:17860:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788658668.421935:0:17860:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788658668.421940:0:17860:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788658668.421962:0:17860:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56e33b3800 00010000:00010000:3.0:1788658668.421966:0:17860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891b400/0xf657f176650ebbe0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebbe7 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658668.421985:0:17860:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658668.421992:0:17860:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658668.421999:0:17860:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788658668.422017:0:17860:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788658668.422018:0:17860:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788658668.422033:0:17860:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9e56e33b3800 00010000:00010000:3.0:1788658668.422037:0:17860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56c891ae00/0xf657f176650ebac8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf657f176650ebacf expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788658668.422057:0:17860:0:(import.c:65:import_set_state_nolock()) ffff9e56e33b3800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788658668.422062:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788658668.422065:0:17860:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788658668.422067:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788658668.422073:0:17860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788658668.422088:0:17860:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9e57007e1c00 x1875544103827584/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788658674 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788658668.422114:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788658668.422117:0:17860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788658668.424258:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7221c739-be00-4743-a572-f61de58b82dc:3303:1875544103827584:0@lo:250:ptlrpcd_00_00.0 00000020:00000080:2.0:1788658668.424473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e55c28f7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788658668.425398:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788658668.425417:0:17860:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebab3 00000020:00000080:3.0:1788658668.425429:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e56ff017000/7221c739-be00-4743-a572-f61de58b82dc 00000020:01000000:3.0:1788658668.425447:0:17860:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.103@tcp (flags='') 00000020:00000080:3.0:1788658668.425460:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658668.425472:0:17860:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788658668.425487:0:17860:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9e56c83e4d40) has no exports 00000020:00000080:0.0:1788658668.425747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56ff017000/7221c739-be00-4743-a572-f61de58b82dc for MGC192.168.202.103@tcp 10000000:01000000:2.0:1788658668.425888:0:14416:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788658668.426051:0:17860:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.103@tcp: client import never connected 00000100:00080000:3.0:1788658668.426056:0:17860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788658668.426060:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788658668.426064:0:17860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788658668.426067:0:17860:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788658668.426136:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658668.426155:0:17860:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.103@tcp (uuid 7221c739-be00-4743-a572-f61de58b82dc) 00000020:01000000:3.0:1788658668.426164:0:17860:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788658668.426169:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658668.426173:0:17860:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788658668.426182:0:17860:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9e55c28f6000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788658668.426210:0:17860:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff9e56e6ee3380) has exports, disconnecting them 00000020:00080000:3.0:1788658668.426215:0:17860:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9e55c28f6000), last request at 1788658613 00000020:00000080:3.0:1788658668.426221:0:17860:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebd61 00000020:00000080:0.0:1788658668.426314:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e56e33b3800 for MGC192.168.202.103@tcp 00000020:00000080:0.0:1788658668.426322:0:8:0:(genops.c:885:class_export_put()) final put ffff9e56e33b7000/7221c739-be00-4743-a572-f61de58b82dc 00000020:00000080:0.0:1788658668.426325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56e33b7000/7221c739-be00-4743-a572-f61de58b82dc for MGC192.168.202.103@tcp 00000020:01000000:0.0:1788658668.426331:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.103@tcp (7221c739-be00-4743-a572-f61de58b82dc) 00000020:00080000:3.0:1788658668.427046:0:17860:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9e55c28f6000): rc 0 00000020:00000080:3.0:1788658668.427054:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e55c28f6000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788658668.427741:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e55c28f6000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788658668.443496:0:17860:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788658668.443514:0:17860:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788658668.443522:0:17860:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788658668.443534:0:17860:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788658668.443764:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9e55c2b9e000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788658668.444089:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788658668.444913:0:14407:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788658668.445408:0:16118:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788658668.445614:0:14402:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9e56c3ff8600:14402] 0 exiting: rc = 1 00000100:00100000:2.0:1788658668.446067:0:14403:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9e56c6adac00:14403] 1 exiting: rc = 0 00000100:00100000:3.0:1788658668.446310:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.447644:0:14406:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9e56de4a8800:14406] 2 exiting: rc = 0 00000100:00100000:0.0:1788658668.447818:0:14405:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9e56c6adbe00:14405] 1 exiting: rc = 0 00000100:00100000:3.0:1788658668.448425:0:17711:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9e56de4f1a00:17711] 3 exiting: rc = 0 00000100:00100000:2.0:1788658668.448614:0:14404:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9e56c6ada600:14404] 0 exiting: rc = 1 00000100:00100000:0.0:1788658668.449102:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449112:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449119:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449127:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449134:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449140:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449146:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449153:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449159:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449233:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449239:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449303:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449313:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449319:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449325:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449332:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449338:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449345:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449353:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449360:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449366:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449373:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449379:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449387:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449393:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449399:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449405:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449410:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449416:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449421:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449426:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449431:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449437:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449464:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449470:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449487:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449494:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449501:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449507:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449513:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449518:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449524:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449530:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449535:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449540:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449546:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449552:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449556:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449561:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449567:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449572:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449583:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449589:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449595:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449600:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449606:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449611:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449616:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.449620:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.450072:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.450082:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.450089:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.450094:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788658668.450100:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788658668.453068:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788658668.453085:0:17860:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788658668.453094:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e56de4fa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788658668.453101:0:17860:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56de4fa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788658668.453133:0:17860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788658668.453199:0:17860:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56eec4f000 1 00000020:00000080:0.0:1788658668.453209:0:17860:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf657f176650ebd1b 00000020:00000080:0.0:1788658668.453217:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e56eec4a000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788658668.453239:0:17860:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788658668.453245:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788658668.453370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56eec4a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788658668.453406:0:17860:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788658668.453411:0:17860:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9e56e6ee4d40) has no exports 00000020:00000080:3.0:1788658668.492956:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658668.492981:0:17860:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788658668.492989:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e56eec49000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788658668.492995:0:17860:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56eec49000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788658668.493009:0:17860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788658668.493297:0:17860:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9e56eec4f800 00000020:01000000:3.0:1788658668.493331:0:17860:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788658668.493338:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788658668.493344:0:17860:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788658668.493351:0:17860:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9e56c56c19c0) has no exports 00000020:00000080:3.0:1788658668.493382:0:17860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788658668.493390:0:17860:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788658668.493393:0:17860:0:(genops.c:885:class_export_put()) final put ffff9e56fefac800/OSS_uuid 00000020:00000080:3.0:1788658668.493395:0:17860:0:(genops.c:844:class_export_destroy()) destroying export ffff9e56fefac800/OSS_uuid for OSS 00000020:01000000:3.0:1788658668.493401:0:17860:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788658668.494784:0:14415:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788658668.496202:0:15100:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9e56fef3ca00:15100] 0 exiting: rc = 1 00000100:00100000:1.0:1788658668.496819:0:15581:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9e56ff39d600:15581] 3 exiting: rc = 0 00000100:00100000:0.0:1788658668.499107:0:15102:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9e56fef3da00:15102] 2 exiting: rc = 0 00000100:00100000:0.0:1788658668.499440:0:15101:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9e56c823be00:15101] 1 exiting: rc = 0 00000100:00100000:3.0:1788658668.501940:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.501956:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.501963:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.501970:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.501976:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502009:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502015:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502023:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502030:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502036:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502042:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502049:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502055:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502061:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502067:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502073:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502079:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502085:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502093:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502099:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502106:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502112:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502119:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502125:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502131:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502136:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502142:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502149:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502155:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502160:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502166:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502172:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502177:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502184:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502190:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502196:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502202:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502209:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502219:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502227:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502245:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502252:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502259:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502267:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502273:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502278:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502284:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502291:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502297:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502304:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502310:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502317:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502323:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502330:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502337:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502343:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502350:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502362:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502369:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502376:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502382:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502387:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502398:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.502405:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788658668.503584:0:15104:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9e57011c5600:15104] 1 exiting: rc = 0 00000100:00100000:0.0:1788658668.503818:0:15103:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9e56ff601200:15103] 0 exiting: rc = 1 00000100:00100000:3.0:1788658668.503975:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.503986:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.503992:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.503999:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504006:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504012:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504026:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504033:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504040:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504047:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504053:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504080:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504085:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504091:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504098:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504104:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504110:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504116:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504121:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504127:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504133:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504138:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504144:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504153:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504160:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504181:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504189:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504196:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504202:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504207:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504212:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504217:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504223:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504230:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504237:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504245:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504250:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504258:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504264:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504270:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504276:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504283:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504289:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504296:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504302:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504308:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504321:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504331:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504338:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504345:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504351:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504357:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504363:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504369:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504375:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504384:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504390:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504396:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504402:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504408:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504413:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504418:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504425:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.504430:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.505646:0:15105:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9e56c823a000:15105] 0 exiting: rc = 1 00000100:00100000:2.0:1788658668.505973:0:15107:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9e57014b2600:15107] 2 exiting: rc = 0 00000100:00100000:1.0:1788658668.506271:0:16649:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9e55c23bf600:16649] 3 exiting: rc = 0 00000100:00100000:0.0:1788658668.506583:0:15106:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9e57014b3c00:15106] 1 exiting: rc = 0 00000100:00100000:3.0:1788658668.507157:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507167:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507174:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507181:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507187:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507195:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507203:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507209:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507215:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507222:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507229:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507238:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507245:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507252:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507260:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507266:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507288:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507295:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507301:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507309:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507316:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507323:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507329:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507351:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507359:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507365:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507374:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507380:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507388:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507394:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507401:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507408:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507414:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507420:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507427:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507435:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507442:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507449:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507456:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507463:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507470:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507476:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507492:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507499:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507506:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507513:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507521:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507545:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507553:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507559:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507566:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507579:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507585:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507592:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507600:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507609:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507616:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507623:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507631:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507637:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507644:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507651:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507658:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.507696:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.517617:0:15108:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9e57014b3e00:15108] 0 exiting: rc = 1 00000100:00100000:1.0:1788658668.518404:0:15109:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9e57014b3a00:15109] 1 exiting: rc = 0 00000100:00100000:3.0:1788658668.518640:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518650:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518657:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518893:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518903:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518909:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518915:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518921:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518927:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518934:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518943:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518949:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518955:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518961:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518968:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518975:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518982:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518991:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.518997:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519003:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519010:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519016:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519042:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519049:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519057:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519064:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519070:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519076:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519081:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519087:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519092:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519098:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519104:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519109:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519115:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519121:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519126:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519132:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519137:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519145:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519208:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519215:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519221:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519228:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519235:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519241:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519250:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519256:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519263:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519270:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519276:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519282:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519289:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519295:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519303:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519309:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519315:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519328:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519335:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519341:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519348:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519355:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519362:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.519368:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788658668.527326:0:15110:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9e56ff57fc00:15110] 0 exiting: rc = 1 00000100:00100000:2.0:1788658668.527781:0:15111:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9e56f44e3a00:15111] 1 exiting: rc = 0 00000100:00100000:2.0:1788658668.527882:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.527893:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.527901:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.527908:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.527928:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528340:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528375:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528382:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528390:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528397:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528405:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528413:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528420:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528428:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528439:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528447:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528462:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528471:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528508:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528517:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528526:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528534:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528541:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528549:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528556:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528565:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528572:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528581:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528590:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528599:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528623:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528644:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528652:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528661:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528699:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528706:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528712:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528727:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528735:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528741:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528756:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528763:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528785:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528793:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528800:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528808:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528815:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528822:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528827:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528834:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528842:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528849:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528856:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528864:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528886:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528895:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528902:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528908:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.528927:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.529635:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.529652:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.529660:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.529686:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788658668.529694:0:17860:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788658668.552325:0:17860:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788658686.830094:0:18473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788658695.247726:0:18933:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658695.247731:0:18933:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788658695.247860:0:18933:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56eee1b000 00000020:01000004:2.0:1788658695.247877:0:18933:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788658695.247885:0:18933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788658695.247901:0:18933:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9e56c56c3380) 00000020:00000080:2.0:1788658695.247918:0:18933:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788658695.270240:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788658695.272890:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788658695.274582:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 427: rc = 0 00100000:10000000:2.0:1788658695.275359:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788658695.275446:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 427: rc = 0 00100000:10000000:3.0:1788658695.278956:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 427: rc = 0 00100000:10000000:3.0:1788658695.279240:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 427: rc = 0 00100000:10000000:3.0:1788658695.279449:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:3.0:1788658695.279567:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:3.0:1788658695.280552:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 429: rc = 0 00100000:10000000:3.0:1788658695.284479:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:3.0:1788658695.284584:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:3.0:1788658695.285358:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.285606:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 773: rc = 0 00100000:10000000:3.0:1788658695.285932:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 773: rc = 0 00100000:10000000:3.0:1788658695.286396:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.286631:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.286881:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 773: rc = 0 00100000:10000000:3.0:1788658695.287238:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 773: rc = 0 00100000:10000000:3.0:1788658695.287581:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.287966:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.288623:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 773: rc = 0 00100000:10000000:3.0:1788658695.288905:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 773: rc = 0 00100000:10000000:3.0:1788658695.289404:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 773: rc = 0 00100000:10000000:3.0:1788658695.290236:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 659: rc = 0 00100000:10000000:3.0:1788658695.291088:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 659: rc = 0 00100000:10000000:3.0:1788658695.291584:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 659: rc = 0 00100000:10000000:3.0:1788658695.294796:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 659: rc = 0 00100000:10000000:3.0:1788658695.296559:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 659: rc = 0 00100000:10000000:3.0:1788658695.296955:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 659: rc = 0 00100000:10000000:3.0:1788658695.297650:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 659: rc = 0 00100000:10000000:3.0:1788658695.297949:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 659: rc = 0 00100000:10000000:3.0:1788658695.299709:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 659: rc = 0 00100000:10000000:3.0:1788658695.299965:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 659: rc = 0 00100000:10000000:3.0:1788658695.301517:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 659: rc = 0 00100000:10000000:3.0:1788658695.301844:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 659: rc = 0 00100000:10000000:3.0:1788658695.303575:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 659: rc = 0 00100000:10000000:3.0:1788658695.303904:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 659: rc = 0 00100000:10000000:2.0:1788658695.306790:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 659: rc = 0 00100000:10000000:2.0:1788658695.307176:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 659: rc = 0 00100000:10000000:2.0:1788658695.307416:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 659: rc = 0 00100000:10000000:2.0:1788658695.307734:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 659: rc = 0 00100000:10000000:2.0:1788658695.307978:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 659: rc = 0 00100000:10000000:2.0:1788658695.308236:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 659: rc = 0 00100000:10000000:2.0:1788658695.308458:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 659: rc = 0 00100000:10000000:2.0:1788658695.308734:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 659: rc = 0 00100000:10000000:2.0:1788658695.308956:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 659: rc = 0 00100000:10000000:2.0:1788658695.309191:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 659: rc = 0 00100000:10000000:2.0:1788658695.309404:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 659: rc = 0 00100000:10000000:2.0:1788658695.311640:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 659: rc = 0 00100000:10000000:2.0:1788658695.311950:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 659: rc = 0 00100000:10000000:2.0:1788658695.312492:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 659: rc = 0 00100000:10000000:2.0:1788658695.313205:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 659: rc = 0 00100000:10000000:2.0:1788658695.313701:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 659: rc = 0 00100000:10000000:2.0:1788658695.313950:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 659: rc = 0 00100000:10000000:2.0:1788658695.314660:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 659: rc = 0 00100000:10000000:2.0:1788658695.315435:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 649: rc = 0 00100000:10000000:2.0:1788658695.322431:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788658695.322607:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1788658695.322814:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788658695.322875:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1788658695.324641:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788658695.324766:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1788658695.326611:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788658695.326728:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1788658695.326942:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788658695.328169:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1788658695.328652:0:18933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788658695.328847:0:18933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00000020:00000080:2.0:1788658695.330094:0:18933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788658695.330104:0:18933:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658695.330125:0:18933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec16d 00000020:01000004:2.0:1788658695.330134:0:18933:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788658695.330139:0:18933:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788658695.330146:0:18933:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56eee1b000 from MGS 00000020:01000004:2.0:1788658695.330150:0:18933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788658695.330160:0:18933:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9e56c56c0000) 00000020:00000080:2.0:1788658695.330173:0:18933:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788658695.330412:0:18933:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56eee1b000 from MGS, refs=2 00080000:01000000:2.0:1788658695.330418:0:18933:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658695.330424:0:18933:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec17b 00000100:00100000:2.0:1788658695.330556:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788658695.330913:0:18933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788658695.330920:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788658695.333980:0:18933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788658695.333992:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788658695.342316:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658695.342525:0:18933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788658695.342531:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788658695.347179:0:18933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788658695.347208:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788658695.348541:0:18933:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788658695.348552:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788658695.364731:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658695.364739:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658695.364741:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.365112:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.365115:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.365117:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.367797:0:18933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788658695.368795:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788658695.384418:0:18933:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788658695.384436:0:18933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788658695.384440:0:18933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788658695.387114:0:18942:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788658695.387310:0:18933:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788658695.387429:0:18933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788658695.388064:0:18933:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788658695.388381:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658695.388575:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788658695.388582:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788658695.397719:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788658695.397742:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788658695.400607:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788658695.400630:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788658695.401524:0:18933:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788658695.401544:0:18933:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.103@tcp' 00000020:01000004:3.0:1788658695.401546:0:18933:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788658695.401574:0:18933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.103@tcp (typ=mgc) 00000020:00000080:3.0:1788658695.401586:0:18933:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.103@tcp (ffff9e56fb3b8000) 00000020:00000080:3.0:1788658695.401600:0:18933:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788658695.401691:0:18933:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56e5c8f800@MGC192.168.202.103@tcp: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1788658695.401834:0:18933:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.103@tcp-0 is initialized 00000040:01000000:3.0:1788658695.401840:0:18933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788658695.404034:0:18947:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788658695.408097:0:18948:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788658695.408823:0:18933:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.103@tcp (uuid 4b7533a2-f0ee-43c1-8561-a2cc551aa877) 00000020:00000080:2.0:1788658695.408852:0:18933:0:(genops.c:1385:class_connect()) connect: client 4b7533a2-f0ee-43c1-8561-a2cc551aa877, cookie 0xf657f176650ec189 00000100:00080000:2.0:1788658695.408866:0:18933:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658695.408873:0:18933:0:(import.c:665:import_select_connection()) MGC192.168.202.103@tcp: import ffff9e56e5c8f800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658695.408913:0:18933:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd9500 x1875544103827712/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658695.408948:0:18933:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4b7533a2-f0ee-43c1-8561-a2cc551aa877->MGS 00000020:01000004:2.0:1788658695.408978:0:18933:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788658695.408982:0:18933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788658695.408997:0:18933:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9e56c56c4d40) 00000100:00100000:0.0:1788658695.409157:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3303:1875544103827712:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788658695.409236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658695.409307:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827712 00000100:00100000:0.0:1788658695.409315:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827712 00000100:00100000:0.0:1788658695.409346:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658695.409353:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e2fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875544103827712:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788658695.409375:0:18943:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4b7533a2-f0ee-43c1-8561-a2cc551aa877@0@lo t0 exp 0000000000000000 cur 586 last 0 00000020:00000080:0.0:1788658695.409400:0:18943:0:(genops.c:1385:class_connect()) connect: client 4b7533a2-f0ee-43c1-8561-a2cc551aa877, cookie 0xf657f176650ec190 00000100:00080000:0.0:1788658695.409550:0:18943:0:(import.c:65:import_set_state_nolock()) ffff9e56eed3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658695.409596:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e2fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+5:3303:x1875544103827712:12345-0@lo:250:mount.lustre.0 Request processed in 241us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.409603:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658695.409653:0:3303:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788658695.409661:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.103@tcp: connect to target with instance 0 00000100:00080000:0.0:1788658695.409752:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788658695.409756:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788658695.409760:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56e5c8f800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788658695.409762:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000020:00000080:2.0:1788658695.409834:0:18933:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1788658695.414837:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788658695.414856:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3303:1875544103827712:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788658695.441484:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658695.442619:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788658695.442627:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788658695.444904:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658695.444923:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788658695.445612:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788658695.445621:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788658695.452941:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658695.453150:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788658695.453157:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788658695.460128:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788658695.460146:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788658695.517930:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658695.518183:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788658695.518191:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788658695.521906:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788658695.521923:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788658695.522542:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658695.522777:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658695.522784:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788658695.523508:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658695.523517:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788658695.524641:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788658695.524875:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788658695.524883:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788658695.525473:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658695.525481:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788658695.526447:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658695.526639:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788658695.526645:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788658695.531587:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788658695.531607:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788658695.546089:0:18933:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658695.546439:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658695.546447:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788658695.548204:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788658695.548216:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788658695.549311:0:18933:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658695.549322:0:18933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788658695.550213:0:18933:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788658695.550241:0:18933:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788658695.550248:0:18933:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788658695.550466:0:18933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788658695.550516:0:18933:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788658695.550521:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788658695.550523:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658695.550524:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658695.550525:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658695.550526:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658695.550528:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658695.550529:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658695.550531:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658695.550533:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658695.550534:0:18933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658695.550537:0:18933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788658695.550539:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658695.550540:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658695.550541:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658695.550543:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658695.550544:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658695.550545:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658695.550546:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658695.550547:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658695.550548:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658695.550549:0:18933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788658695.550659:0:18933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788658695.550828:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103827840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658695.550912:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.551008:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.551059:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827840 00000100:00100000:0.0:1788658695.551069:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827840 00000100:00100000:0.0:1788658695.551187:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658695.551198:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e2fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+5:18933:x1875544103827840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658695.551255:0:18946:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788658695.551259:0:18946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788658695.551262:0:18946:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788658695.551748:0:18967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788658695.552139:0:18946:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1788658695.553844:0:18968:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788658695.553852:0:18968:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788658695.553854:0:18968:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788658695.553885:0:18968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788658695.554224:0:18946:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788658695.554236:0:18946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788658695.562376:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e2fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+5:18933:x1875544103827840:12345-0@lo:253:mount.lustre.0 Request processed in 11168us (11452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.562397:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658695.562863:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103827840:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658695.562895:0:18933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788658695.562899:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658695.562907:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788658695.562909:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658695.562910:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658695.562911:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658695.562912:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658695.562914:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788658695.562916:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788658695.562917:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658695.562918:0:18933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788658695.563028:0:18933:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56eee1b000 from lustre-MDT0000 10000000:01000000:3.0:1788658695.563070:0:18933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788658695.563073:0:18933:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788658695.563077:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9e56fb3b8000 10000000:01000000:3.0:1788658695.563082:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658695.563091:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9e56fb3b8000 from 1 10000000:01000000:3.0:1788658695.563093:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788658695.563135:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.563146:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.563155:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.563175:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103827968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658695.563235:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.563312:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.563427:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103827968 00000100:00100000:0.0:1788658695.563433:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103827968 00000100:00100000:0.0:1788658695.563525:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658695.563535:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+5:18933:x1875544103827968:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658695.563547:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658695.563565:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79800/0xf657f176650ec1a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec19e expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.563662:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79800/0xf657f176650ec1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec19e expref: 6 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.563752:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79800/0xf657f176650ec1a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec19e expref: 6 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.563772:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79800, rc 0) 00000100:00100000:0.0:1788658695.563884:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+6:18933:x1875544103827968:12345-0@lo:101:mount.lustre.0 Request processed in 351us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.563890:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658695.564047:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103827968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658695.564061:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.564071:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.564121:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.564144:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.564211:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.564251:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828096 00000100:00100000:0.0:1788658695.564255:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828096 00000100:00100000:0.0:1788658695.564309:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658695.564316:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+6:18933:x1875544103828096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.564733:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828096:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658695.564760:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788658695.564775:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.564783:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658695.564805:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56eee1b000 10000000:01000000:3.0:1788658695.564822:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658695.564828:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9e56eee1b000 10000000:01000000:3.0:1788658695.564830:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788658695.564832:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9e56eee1b000 from 1 10000000:01000000:3.0:1788658695.564835:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788658695.564855:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.564862:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.564870:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.564882:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658695.564911:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658695.564975:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+6:18933:x1875544103828096:12345-0@lo:501:mount.lustre.0 Request processed in 252us (423us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788658695.564984:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788658695.565066:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.565183:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828224 00000100:00100000:0.0:1788658695.565187:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828224 00000100:00100000:0.0:1788658695.565206:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658695.565214:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+6:18933:x1875544103828224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658695.565222:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658695.565234:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78e00/0xf657f176650ec1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec1ac expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.565252:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78e00/0xf657f176650ec1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec1ac expref: 7 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.565262:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78e00/0xf657f176650ec1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec1ac expref: 7 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.565269:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78e00, rc 0) 00000100:00100000:0.0:1788658695.565309:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+7:18933:x1875544103828224:12345-0@lo:101:mount.lustre.0 Request processed in 96us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.565324:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658695.565644:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658695.565655:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1b3 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.565701:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec1b3 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658695.565714:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788658695.565725:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1b3 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.565731:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deaccc00/0xf657f176650ec1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1b3 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658695.565737:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788658695.565740:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658695.565744:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9e56eee1b000 10000000:01000000:3.0:1788658695.565747:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788658695.565749:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788658695.565751:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788658695.565765:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.565772:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.565778:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.565847:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658695.565873:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.565884:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.565969:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828352 00000100:00100000:0.0:1788658695.565974:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828352 00000100:00100000:0.0:1788658695.565992:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658695.565998:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+7:18933:x1875544103828352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658695.566005:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658695.566013:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79400/0xf657f176650ec1c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec1ba expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.566026:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79400/0xf657f176650ec1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec1ba expref: 8 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.566034:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79400/0xf657f176650ec1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec1ba expref: 8 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.566040:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79400, rc 0) 00000100:00100000:0.0:1788658695.566064:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+8:18933:x1875544103828352:12345-0@lo:101:mount.lustre.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.566070:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658695.566190:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658695.566201:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1c1 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.566208:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec1c1 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.566246:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.566268:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.566295:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.566332:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828480 00000100:00100000:0.0:1788658695.566337:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828480 00000100:00100000:0.0:1788658695.566461:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788658695.566469:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+8:18933:x1875544103828480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658695.567002:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18933:x1875544103828480:12345-0@lo:501:mount.lustre.0 Request processed in 532us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.567011:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658695.567075:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.567104:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828608:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658695.567144:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.567695:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658695.567942:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828608 00000100:00100000:2.0:1788658695.567949:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828608 00000100:00100000:3.0:1788658695.568056:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658695.568063:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18933:x1875544103828608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658695.568412:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18933:x1875544103828608:12345-0@lo:503:mount.lustre.0 Request processed in 347us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.568419:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658695.568525:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103828608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658695.569336:0:18969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18969:1875544103828736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658695.569402:0:18969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.569443:0:18969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.569564:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103828736 00000100:00100000:3.0:1788658695.569581:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103828736 00000100:00100000:3.0:1788658695.569613:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658695.569622:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18969:x1875544103828736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658695.570094:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18969:x1875544103828736:12345-0@lo:502:llog_process_th.0 Request processed in 470us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.570113:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788658695.570223:0:18969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18969:1875544103828736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788658695.570252:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658695.570264:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658695.570267:0:18969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788658695.570273:0:18969:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788658695.570276:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658695.570292:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9e56c56c19c0) 00000020:00000080:2.0:1788658695.570314:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788658695.570321:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788658695.570409:0:18969:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788658695.570418:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec1cf 00000020:00000080:3.0:1788658695.571124:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788658695.571131:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.571137:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.571139:0:18969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788658695.571145:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.571149:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.571151:0:18969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788658695.571155:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658695.571164:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9e56fb3bb380) 00000020:00000080:3.0:1788658695.571180:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788658695.571185:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788658695.571186:0:18969:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788658695.571190:0:18969:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788658695.571196:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788658695.571271:0:18969:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56eee1b000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788658695.571285:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9e56fb3bcd40) 00000020:00000080:3.0:1788658695.571295:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788658695.571360:0:18969:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788658695.571367:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ec1e4 00000020:00000080:3.0:1788658695.571535:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788658695.571541:0:18969:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788658695.571546:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf657f176650ec1eb 00080000:01000000:3.0:1788658695.571551:0:18969:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788658695.571555:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec1f2 00010000:00010000:3.0:1788658695.680832:0:18969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788658695.681246:0:18969:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934626 00000001:00080000:3.0:1788658695.683542:0:18969:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788658695.686651:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9e56fb3b99c0) 00000020:00000080:3.0:1788658695.686693:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788658695.686781:0:18969:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788658695.686929:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec200 00000020:00000080:3.0:1788658695.690821:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788658695.704979:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf657f176650ec207 00000020:00000080:0.0:1788658695.705635:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788658695.705648:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658695.705655:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658695.705657:0:18969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788658695.705660:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658695.705691:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658695.705693:0:18969:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788658695.705698:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788658695.705734:0:18969:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788658695.705747:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658695.705749:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658695.705750:0:18969:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788658695.705752:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788658695.705754:0:18969:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1788658695.705756:0:18969:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658695.705758:0:18969:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658695.705759:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788658695.705761:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658695.705762:0:18969:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788658695.705764:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788658695.705767:0:18969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788658695.705770:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658695.705771:0:18969:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788658695.705773:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788658695.705778:0:18969:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:0.0:1788658695.705814:0:18969:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788658695.705817:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658695.705832:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9e56e6ee3380) 00000020:00000080:0.0:1788658695.705846:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788658695.705850:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788658695.705895:0:18969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788658695.705899:0:18969:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788658695.705905:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec215 00010000:00080000:0.0:1788658695.705939:0:18969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e57006cd800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1788658695.706297:0:18969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788658695.706748:0:18969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788658695.706821:0:18969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788658695.707754:0:18969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658695.707813:0:18969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788658695.707889:0:18969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788658695.709827:0:18973:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788658695.709835:0:18973:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788658695.710598:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658695.710613:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658695.710657:0:18969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788658695.711014:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ec21c 00000100:00080000:3.0:1788658695.711029:0:18969:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658695.711035:0:18969:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e57006cd800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658695.711075:0:18969:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56eec5e300 x1875544103828864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658695.711144:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103828864:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788658695.711413:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103828864 offset 0 length 520: 4 00000100:00080000:3.0:1788658695.711532:0:18969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788658695.711613:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.711619:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.711621:0:18969:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788658695.711624:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788658695.711627:0:18969:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788658695.711628:0:18969:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658695.711630:0:18969:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788658695.711631:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788658695.711634:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.711635:0:18969:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788658695.711638:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788658695.711642:0:18969:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788658695.711645:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.711646:0:18969:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788658695.711649:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788658695.711652:0:18969:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:3.0:1788658695.711698:0:18969:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788658695.711701:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788658695.711736:0:18969:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9e56c741b380) 00000020:00000080:3.0:1788658695.711756:0:18969:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788658695.711766:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788658695.711860:0:18969:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788658695.711866:0:18969:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788658695.711873:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf657f176650ec22a 00010000:00080000:3.0:1788658695.711914:0:18969:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56d183b000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1788658695.712138:0:18969:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788658695.713006:0:18969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788658695.713038:0:18969:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788658695.713921:0:18969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658695.714004:0:18969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788658695.714076:0:18969:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788658695.714605:0:18975:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788658695.714615:0:18975:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788658695.715651:0:18969:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788658695.715875:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788658695.715917:0:18969:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788658695.715941:0:18969:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ec231 00000100:00080000:3.0:1788658695.715953:0:18969:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788658695.715959:0:18969:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183b000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658695.715998:0:18969:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56eec5e680 x1875544103828992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658695.716087:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103828992:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788658695.716148:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103828992 offset 0 length 520: 4 00000100:00080000:3.0:1788658695.716487:0:18969:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788658695.716572:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.716576:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.716578:0:18969:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788658695.716581:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.716584:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.716586:0:18969:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788658695.716588:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788658695.716590:0:18969:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788658695.716592:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.716594:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.716595:0:18969:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788658695.716609:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.716612:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.716613:0:18969:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788658695.716617:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788658695.716651:0:18969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18969:1875544103829120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658695.716735:0:18969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.716762:0:18969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f4500480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658695.717090:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829120 00000100:00100000:2.0:1788658695.717099:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829120 00000100:00100000:2.0:1788658695.717149:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788658695.717159:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18969:x1875544103829120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658695.717731:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18969:x1875544103829120:12345-0@lo:502:llog_process_th.0 Request processed in 570us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658695.717747:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788658695.718097:0:18969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18969:1875544103829120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658695.718132:0:18969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.718139:0:18969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.718140:0:18969:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788658695.718145:0:18969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788658695.718514:0:18933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788658695.718536:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788658695.718563:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1c1 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.718573:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacc000/0xf657f176650ec1ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1c1 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658695.718580:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56eee1b000 from 1 10000000:01000000:2.0:1788658695.718583:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658695.718618:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.718627:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.718636:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.718656:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829248:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658695.718948:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.719026:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658695.719320:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829248 00000100:00100000:1.0:1788658695.719328:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829248 00000100:00100000:1.0:1788658695.719487:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788658695.719499:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+9:18933:x1875544103829248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658695.719516:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658695.719536:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec238 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.719566:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec238 expref: 10 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.719576:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec238 expref: 10 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.719585:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35a00, rc 0) 00000100:00100000:1.0:1788658695.719645:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+10:18933:x1875544103829248:12345-0@lo:101:mount.lustre.0 Request processed in 148us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658695.719652:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658695.719905:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658695.719921:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.719931:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.720560:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829376:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788658695.720607:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.721011:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658695.721109:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829376 00000100:00100000:1.0:1788658695.721115:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829376 00000100:00100000:1.0:1788658695.721141:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788658695.721148:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+10:18933:x1875544103829376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788658695.721166:0:18945:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788658695.721172:0:18945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788658695.721427:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+10:18933:x1875544103829376:12345-0@lo:256:mount.lustre.0 Request processed in 277us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658695.721436:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658695.722004:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829376:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788658695.723032:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658695.723153:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.723167:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658695.723177:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56eee1b000 from 1 10000000:01000000:2.0:1788658695.723186:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658695.723226:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.723234:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.723244:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.723263:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658695.723315:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.723445:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.724102:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829504 00000100:00100000:0.0:1788658695.724111:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829504 00000100:00100000:1.0:1788658695.724468:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788658695.724502:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+10:18933:x1875544103829504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658695.724518:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658695.724536:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec246 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.724564:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec246 expref: 11 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.724576:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec246 expref: 11 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.724585:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35800, rc 0) 00000100:00100000:1.0:1788658695.724648:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103829504:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658695.724655:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658695.724972:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658695.724999:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.725010:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.725079:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658695.725192:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.725223:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.725268:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829632 00000100:00100000:3.0:1788658695.725273:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829632 00000100:00100000:3.0:1788658695.725312:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788658695.725319:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103829632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.726021:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103829632:12345-0@lo:501:mount.lustre.0 Request processed in 699us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.726032:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658695.726312:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658695.726437:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658695.726497:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.726568:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.726685:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829760 00000100:00100000:0.0:1788658695.726693:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829760 00000100:00100000:0.0:1788658695.726723:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788658695.726731:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103829760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658695.727035:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103829760:12345-0@lo:503:mount.lustre.0 Request processed in 304us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.727043:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658695.727229:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103829760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658695.728252:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18977:1875544103829888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658695.728318:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.728431:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d1d76d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.728495:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103829888 00000100:00100000:0.0:1788658695.728503:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103829888 00000100:00100000:0.0:1788658695.728550:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788658695.728560:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18977:x1875544103829888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658695.728959:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18977:x1875544103829888:12345-0@lo:502:llog_process_th.0 Request processed in 399us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.728974:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788658695.729218:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18977:1875544103829888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658695.729266:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.729276:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.729279:0:18977:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788658695.729287:0:18977:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56eee1b000 00000020:00000080:3.0:1788658695.729290:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658695.729297:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.729299:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.729300:0:18977:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788658695.729301:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.729308:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.729310:0:18977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788658695.729313:0:18977:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56eee1b000 00000020:00000080:3.0:1788658695.729315:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658695.729381:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.729385:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.729386:0:18977:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788658695.729388:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658695.729390:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.729392:0:18977:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658695.729395:0:18977:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56eee1b000 00000020:00000080:3.0:1788658695.729396:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788658695.729435:0:18977:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18977:1875544103830016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658695.729484:0:18977:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.729510:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830016 00000100:00100000:3.0:1788658695.729515:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830016 00000100:00100000:3.0:1788658695.729541:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658695.729548:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18977:x1875544103830016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788658695.729719:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18977:x1875544103830016:12345-0@lo:502:llog_process_th.0 Request processed in 171us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.729725:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788658695.729761:0:18977:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d17539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.729773:0:18977:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18977:1875544103830016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788658695.730242:0:18977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658695.730248:0:18977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658695.730250:0:18977:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788658695.730255:0:18977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788658695.730319:0:18933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788658695.730346:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658695.730370:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730381:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658695.730428:0:18933:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788658695.730431:0:18933:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56eee1b000 10000000:01000000:3.0:1788658695.730434:0:18933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56eee1b000 10000000:01000000:3.0:1788658695.730438:0:18933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658695.730444:0:18933:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56eee1b000 from 1 10000000:01000000:3.0:1788658695.730447:0:18933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788658695.730485:0:18933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730493:0:18933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730502:0:18933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.730517:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658695.730556:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.730575:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d17539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.730603:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830144 00000100:00100000:3.0:1788658695.730608:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830144 00000100:00100000:3.0:1788658695.730636:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658695.730644:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103830144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658695.730654:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658695.730697:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56deacd800/0xf657f176650ec25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec254 expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730731:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56deacd800/0xf657f176650ec25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec254 expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730743:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56deacd800/0xf657f176650ec25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec254 expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730752:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacd800, rc 0) 00000100:00100000:3.0:1788658695.730874:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830144:12345-0@lo:101:mount.lustre.0 Request processed in 229us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.730881:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788658695.730919:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658695.730932:0:18933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec25b expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.730942:0:18933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec25b expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658695.730985:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.731010:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.731022:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d17539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.731034:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830272 00000100:00100000:3.0:1788658695.731037:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830272 00000100:00100000:3.0:1788658695.731058:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658695.731065:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.731511:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830272:12345-0@lo:501:mount.lustre.0 Request processed in 446us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.731527:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788658695.731562:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658695.731589:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658695.731623:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.731636:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d17539c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658695.731648:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830400 00000100:00100000:3.0:1788658695.731651:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830400 00000100:00100000:3.0:1788658695.731693:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658695.731699:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658695.733069:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830400:12345-0@lo:503:mount.lustre.0 Request processed in 1365us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658695.733082:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788658695.733653:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658695.746591:0:18979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18979:1875544103830528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788658695.747483:0:18979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.747604:0:18979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4ee0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658695.755684:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830528 00000100:00100000:0.0:1788658695.755701:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830528 00000100:00100000:0.0:1788658695.755760:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658695.755769:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18979:x1875544103830528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658695.756215:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18979:x1875544103830528:12345-0@lo:502:llog_process_th.0 Request processed in 445us (8744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.756224:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788658695.756324:0:18979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18979:1875544103830528:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788658695.756412:0:18979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788658695.756429:0:18979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9e56e6ee0000) 00000020:00000080:0.0:1788658695.756453:0:18979:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788658695.756561:0:18979:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56eee1b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788658695.756566:0:18979:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56eee1b000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788658695.756569:0:18979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56eee1b000 4 00010000:00080000:0.0:1788658695.756599:0:18979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56de4fd000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1788658695.766011:0:18979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788658695.767564:0:18979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788658695.767609:0:18979:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788658695.767623:0:18979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf657f176650ec269 00000100:00080000:0.0:1788658695.767634:0:18979:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788658695.767642:0:18979:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e56de4fd000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1788658695.767701:0:18979:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57008fce00 x1875544103830656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788658695.767742:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103830656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658695.768632:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788658695.768719:0:18979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788658695.769460:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830656 00000100:00100000:1.0:1788658695.769480:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830656 00000100:00100000:1.0:1788658695.769517:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658695.769526:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103830656:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658695.769600:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875544103830656:12345-0@lo:38:llog_process_th.0 Request processed in 74us (971us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788658695.769608:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658695.769770:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788658695.770888:0:18979:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18979:1875544103830784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658695.770961:0:18979:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658695.771000:0:18979:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f44b86c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788658695.771435:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56de4fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658695.771442:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788658695.771447:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103830656:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658695.771918:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830784 00000100:00100000:0.0:1788658695.771927:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830784 00000100:00100000:0.0:1788658695.771975:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658695.771984:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18979:x1875544103830784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788658695.777691:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18979:x1875544103830784:12345-0@lo:502:llog_process_th.0 Request processed in 5677us (6698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658695.777705:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788658695.778541:0:18979:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18979:1875544103830784:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788658695.778596:0:18979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788658695.781817:0:18933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788658695.781858:0:18933:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788658695.781886:0:18933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec25b expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658695.781898:0:18933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacdc00/0xf657f176650ec254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec25b expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788658695.781950:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788658695.781952:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658695.781954:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658695.781955:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658695.781956:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658695.781957:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658695.781963:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658695.781964:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658695.781966:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658695.781967:0:18933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658695.781971:0:18933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788658695.781973:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788658695.781974:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658695.781975:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658695.781976:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658695.781977:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658695.781978:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658695.781979:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658695.781979:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658695.781980:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658695.781981:0:18933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788658695.782008:0:18933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788658695.782030:0:18933:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788658695.782112:0:18933:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658695.782908:0:18933:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c67e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658695.787304:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103830912 00000100:00100000:1.0:1788658695.787321:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103830912 00000100:00100000:0.0:1788658695.787759:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658695.787768:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18933:x1875544103830912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658695.787810:0:18946:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788658695.787823:0:18946:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788658695.861027:0:18946:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658695.861049:0:18946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788658695.861172:0:18967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788658695.861177:0:18967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788658695.861216:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.861238:0:18967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec238 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.861248:0:18967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.861291:0:18967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658695.861324:0:18967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 12 pid: 18945 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658695.861340:0:18967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103831040:0@lo:104: 00000100:00100000:0.0:1788658695.861414:0:18967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658695.861460:0:18967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ca6cbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658695.861662:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831040 00000100:00100000:1.0:1788658695.861719:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831040 00000100:00100000:1.0:1788658695.861759:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658695.861770:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103831040:12345-0@lo:104: 00010000:00010000:1.0:1788658695.861795:0:18934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658695.861852:0:18934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788658695.861858:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103831040:12345-0@lo:104: Request processed in 91us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658695.861865:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658695.861901:0:18967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103831040:0@lo:104: 00010000:00010000:1.0:1788658695.861920:0:18967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.861927:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658695.861934:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.861940:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efc00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:2.0:1788658695.861950:0:18940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.861958:0:18940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788658695.861966:0:18940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658695.861972:0:18940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788658695.862004:0:18940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862011:0:18940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788658695.862032:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862038:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec23f expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862053:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.862055:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658695.862057:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658695.862078:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658695.862087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103831168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788658695.862119:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658695.862162:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831168 00000100:00100000:2.0:1788658695.862166:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831168 00010000:00010000:2.0:1788658695.862186:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 13 pid: 18945 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.862219:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658695.862225:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+13:3307:x1875544103831168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658695.862236:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658695.862242:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 13 pid: 18945 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862252:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 13 pid: 18945 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862265:0:18936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec23f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec238 expref: 13 pid: 18945 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862278:0:18936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862286:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788658695.862298:0:18936:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001121961s 00010000:00010000:2.0:1788658695.862302:0:18936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862310:0:18936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862316:0:18936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862322:0:18936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862347:0:18936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658695.862352:0:18936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862359:0:18936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862372:0:18936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862381:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658695.862410:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:3307:x1875544103831168:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658695.862417:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658695.862442:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103831168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788658695.862459:0:18967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862478:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658695.862484:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac78200/0xf657f176650ec270 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658695.869039:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18933:x1875544103830912:12345-0@lo:253:mount.lustre.0 Request processed in 81257us (86912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658695.869060:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788658695.870646:0:18933:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18933:1875544103830912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788658695.870703:0:18933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788658695.870707:0:18933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788658695.870710:0:18933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788658695.870711:0:18933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788658695.870712:0:18933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788658695.870713:0:18933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788658695.870714:0:18933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788658695.870716:0:18933:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788658695.870718:0:18933:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788658695.870720:0:18933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788658695.870721:0:18933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788658695.870741:0:18933:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788658695.884891:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658695.887413:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658695.887944:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658695.888129:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658695.892992:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658695.895855:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658695.904419:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658695.904600:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788658695.904949:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658695.908509:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788658695.909028:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788658695.909201:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788658695.974833:0:18933:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:1.0:1788658695.975589:0:18933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788658695.975963:0:18990:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:3.0:1788658695.975968:0:18990:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:01000000:1.0:1788658695.976108:0:18991:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788658695.976187:0:18991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788658695.978735:0:18991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788658695.978829:0:18991:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788658695.978833:0:18991:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788658695.981123:0:18933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788658695.981246:0:18933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788658695.981705:0:18933:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788658695.981714:0:18933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788658695.981975:0:18933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658695.983182:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788658695.984032:0:18933:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788658695.984082:0:18933:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788658695.984905:0:18933:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788658695.985608:0:18933:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1788658695.992123:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788658696.031690:0:18933:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788658696.031849:0:18933:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbdf241c6b988 00100000:10000000:1.0:1788658696.031861:0:18933:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788658696.033068:0:18933:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658696.033085:0:18933:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658696.033114:0:18933:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788658696.033144:0:18933:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788658696.415574:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658696.804044:0:18984:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658696.804057:0:18984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658696.804438:0:18984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788658696.804447:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788658696.928211:0:18948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788658696.928221:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56eee1b000 from 9 10000000:01000000:3.0:1788658696.928228:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788658696.928282:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658696.928296:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658696.928308:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658696.928337:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103831296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658696.928426:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658696.928487:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958480 going to sleep for 11 seconds 00000100:00100000:2.0:1788658696.928598:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831296 00000100:00100000:2.0:1788658696.928611:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831296 00000100:00100000:2.0:1788658696.928680:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658696.928768:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18948:x1875544103831296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658696.928786:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658696.928804:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec277 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658696.928834:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec277 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658696.928846:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec277 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658696.928855:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007eec00, rc 0) 00000100:00100000:2.0:1788658696.928908:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103831296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658696.928914:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788658696.929461:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103831296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658696.929477:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658696.929486:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658696.929540:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103831424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658696.929578:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658696.929616:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ff958480 going to sleep for 11 seconds 00000100:00100000:1.0:1788658696.929944:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831424 00000100:00100000:1.0:1788658696.929951:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831424 00000100:00100000:1.0:1788658696.929982:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788658696.929991:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d6cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103831424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658696.930010:0:18946:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658696.930026:0:18946:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658696.930029:0:18946:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788658696.930111:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d6cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103831424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658696.930118:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788658696.930289:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103831424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788658696.930329:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788658696.930337:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658696.930345:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658697.438535:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788658697.823461:0:18984:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788658697.823476:0:18984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658697.827750:0:18984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788658697.829445:0:18984:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788658697.829483:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:3.0:1788658698.463995:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658699.488658:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658700.520167:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658700.623445:0:19234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1788658701.215468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658701.215486:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658701.215488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658701.215491:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788658701.215494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788658701.215497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788658701.215501:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e56de4fd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658701.215513:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9e56de4fd000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658701.215538:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefdb100 x1875544103831680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658701.215568:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788658701.215580:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103831552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658701.215646:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658701.215733:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831552 00000100:00100000:2.0:1788658701.215741:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831552 00000100:00100000:2.0:1788658701.215896:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788658701.215908:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:3306:x1875544103831552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658701.215966:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:3306:x1875544103831552:12345-0@lo:400:kworker.0 Request processed in 61us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658701.215974:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788658701.216096:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103831552:0@lo:400:kworker.0 00000100:00100000:2.0:1788658701.216141:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103831680:0@lo:38:kworker.0 00000100:00100000:2.0:1788658701.216178:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658701.216271:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831680 00000100:00100000:3.0:1788658701.216276:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831680 00000100:00100000:3.0:1788658701.216305:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658701.216310:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875544103831680:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788658701.216384:0:18953:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:3.0:1788658701.216416:0:18953:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf657f176650ec285 00000004:00100000:3.0:1788658701.216431:0:18953:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788658701.216565:0:18953:0:(import.c:65:import_set_state_nolock()) ffff9e56f44a9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658701.216607:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875544103831680:12345-0@lo:38:kworker.0 Request processed in 295us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658701.216614:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788658701.216888:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e56fefdb100 x1875544103831680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658701.216902:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788658701.216916:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788658701.216921:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788658701.216923:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56de4fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788658701.216929:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875544103831680:0@lo:38:kworker.0 00010000:00010000:3.0:1788658701.536526:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658702.557061:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658703.382313:0:19384:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffb0a4130 20000000:00000080:0.0:1788658703.382337:0:19384:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e5700845400 uarg=0000000000000000 20000000:01000000:0.0:1788658703.382374:0:19384:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788658703.382463:0:19384:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788658703.382468:0:19384:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788658703.383479:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788658703.383995:0:19384:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788658703.390155:0:19384:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788658703.390320:0:19384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658703.390342:0:19384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec246 expref: 11 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658703.390350:0:19384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658703.390479:0:19384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 11 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658703.390496:0:19384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 11 pid: 18945 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658703.390511:0:19384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19384:1875544103831808:0@lo:104: 00000100:00100000:1.0:1788658703.390581:0:19384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658703.390701:0:19384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c4c0d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658703.390892:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831808 00000100:00100000:0.0:1788658703.390900:0:18935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831808 00000100:00100000:0.0:1788658703.390944:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658703.390954:0:18935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:19384:x1875544103831808:12345-0@lo:104: 00010000:00010000:0.0:1788658703.390970:0:18935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658703.391036:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658703.391043:0:18935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:19384:x1875544103831808:12345-0@lo:104: Request processed in 90us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658703.391050:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788658703.391188:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658703.391195:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391203:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efa00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658703.391207:0:18940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391216:0:18940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658703.391223:0:18940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658703.391229:0:18940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658703.391269:0:18940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391275:0:18940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658703.391306:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391313:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007efa00/0xf657f176650ec246 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec24d expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391330:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658703.391332:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658703.391334:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658703.391364:0:19384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19384:1875544103831808:0@lo:104: 00010000:00010000:3.0:1788658703.391396:0:19384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658703.391468:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658703.391478:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103831936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658703.391512:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658703.391817:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103831936 00000100:00100000:3.0:1788658703.391823:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103831936 00010000:00010000:3.0:1788658703.391864:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 12 pid: 18945 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658703.391896:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658703.391903:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:3305:x1875544103831936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658703.391915:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658703.391920:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 12 pid: 18945 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391931:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 12 pid: 18945 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391945:0:18936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed35800/0xf657f176650ec24d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec246 expref: 12 pid: 18945 timeout: 694 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391959:0:18936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391973:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391986:0:18936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.391993:0:18936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392000:0:18936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392007:0:18936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392011:0:18936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658703.392016:0:18936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392023:0:18936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392040:0:18936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.392050:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658703.392096:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:3305:x1875544103831936:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658703.392103:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788658703.392244:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103831936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658703.392266:0:19384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658703.392274:0:19384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658703.392281:0:19384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed34800/0xf657f176650ec28c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658703.581152:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658704.611056:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788658705.052791:0:18948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788658705.052802:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56eee1b000 from 10 10000000:01000000:0.0:1788658705.052808:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788658705.052860:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658705.052873:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658705.052885:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658705.052920:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788658705.052990:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658705.053047:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658705.053357:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832064 00000100:00100000:1.0:1788658705.053367:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832064 00000100:00100000:1.0:1788658705.053424:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788658705.053434:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+11:18948:x1875544103832064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658705.053459:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658705.053475:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec293 expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658705.053498:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec293 expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658705.053509:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec293 expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658705.053518:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35200, rc 0) 00000100:00100000:1.0:1788658705.053565:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103832064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658705.053572:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788658705.053850:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658705.053867:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658705.053877:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658705.053949:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658705.053978:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658705.054015:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92ba600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658705.054126:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832192 00000100:00100000:1.0:1788658705.054139:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832192 00000100:00100000:1.0:1788658705.054171:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788658705.054178:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103832192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658705.055432:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658705.055575:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658705.055622:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658705.055654:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658705.055687:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832320 00000100:00100000:2.0:1788658705.055692:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832320 00000100:00100000:2.0:1788658705.055727:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788658705.055735:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+13:18948:x1875544103832320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658705.056837:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103832192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1032us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658705.056858:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788658705.059352:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:18948:x1875544103832320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3607us (3719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658705.059383:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788658705.059893:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103832320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788658705.070027:0:19453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788658705.070132:0:18948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788658705.070170:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658705.070186:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658705.070199:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658705.311108:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658695/real 1788658695] req@ffff9e56eec5e680 x1875544103828992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658705.311137:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e56eec5e680 x1875544103828992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658705.311147:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658695/real 1788658695] req@ffff9e56eec5e300 x1875544103828864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658705.311157:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e56eec5e300 x1875544103828864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658705.311176:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658705.311198:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658705.311201:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103828992:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788658705.311218:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e57006cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788658705.311224:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788658705.311226:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103828864:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788658705.311325:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658705.311329:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788658705.311332:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e57006cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658705.311337:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1788658705.311343:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658705.311351:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e57006cd800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658705.311384:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57007e3100 x1875544103832448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788658705.311408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658705.311411:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658705.311413:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658705.311416:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 586 00000100:00080000:1.0:1788658705.311418:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788658705.311422:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183b000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658705.311432:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57007e1880 x1875544103832576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658705.311492:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103832704:0@lo:400:kworker.0 00000100:00100000:3.0:1788658705.311559:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658705.311698:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103832448:0@lo:8:kworker.0 00000400:00000100:2.0:1788658705.311729:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103832448 offset 0 length 520: 4 00000100:00100000:2.0:1788658705.311759:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103832576:0@lo:8:kworker.0 00000400:00000100:2.0:1788658705.311774:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875544103832576 offset 0 length 520: 4 00000100:00100000:0.0:1788658705.312932:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832704 00000100:00100000:0.0:1788658705.312943:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832704 00000100:00100000:0.0:1788658705.314354:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658705.314370:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103832704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658705.314602:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875544103832704:12345-0@lo:400:kworker.0 Request processed in 237us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658705.314610:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788658705.316364:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9e57007e1180 x1875544103832704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658705.316381:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875544103832704:0@lo:400:kworker.0 00010000:00010000:0.0:1788658705.640155:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658706.657221:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658707.037298:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788658707.677283:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788658708.358546:0:19635:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788658708.358549:0:19635:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788658708.358661:0:19635:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56d183a800 00000020:01000004:3.0:1788658708.358704:0:19635:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788658708.358717:0:19635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788658708.358731:0:19635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9e56c7418000) 00000020:00000080:3.0:1788658708.358746:0:19635:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788658708.389703:0:19635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788658708.389920:0:19635:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788658708.397591:0:19635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788658708.397937:0:19635:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788658708.405481:0:19635:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788658708.406027:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788658708.406139:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788658708.406235:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788658708.406846:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658708.407093:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658708.407355:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 111: rc = 0 00100000:10000000:2.0:1788658708.407628:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 111: rc = 0 00100000:10000000:2.0:1788658708.414130:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 111: rc = 0 00100000:10000000:2.0:1788658708.415851:0:19635:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 111: rc = 0 00000020:00000080:2.0:1788658708.416473:0:19635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788658708.416484:0:19635:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788658708.416498:0:19635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ec2a8 00000020:01000004:2.0:1788658708.416507:0:19635:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788658708.416525:0:19635:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788658708.416528:0:19635:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788658708.416532:0:19635:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788658708.416535:0:19635:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788658708.416545:0:19635:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9e56c8913380) 00000020:00000080:2.0:1788658708.416552:0:19635:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788658708.423087:0:19635:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658708.423428:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788658708.423436:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788658708.445580:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788658708.445606:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788658708.446899:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788658708.446912:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788658708.452054:0:19635:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788658708.452270:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788658708.452277:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788658708.453953:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788658708.453968:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788658708.497588:0:19635:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658708.497957:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788658708.497964:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788658708.499575:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788658708.499595:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788658708.500820:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788658708.500829:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788658708.503956:0:19635:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788658708.504118:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788658708.504125:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788658708.506176:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788658708.506195:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788658708.544718:0:19635:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788658708.544945:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788658708.544951:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788658708.546018:0:19635:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788658708.546029:0:19635:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788658708.546902:0:19635:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788658708.546929:0:19635:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788658708.546934:0:19635:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788658708.559940:0:19635:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658708.559985:0:19635:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788658708.559990:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658708.559992:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658708.559993:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658708.559995:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658708.559996:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658708.559998:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658708.560000:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658708.560001:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658708.560003:0:19635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658708.560008:0:19635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788658708.560010:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658708.560012:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658708.560013:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658708.560014:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658708.560015:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658708.560016:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658708.560017:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658708.560018:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658708.560019:0:19635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658708.560047:0:19635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788658708.560070:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103832832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658708.560153:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.560258:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658708.560307:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832832 00000100:00100000:0.0:1788658708.560316:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832832 00000100:00100000:0.0:1788658708.560492:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788658708.560502:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:19635:x1875544103832832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658708.560530:0:18946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788658708.560533:0:18946:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788658708.560537:0:18946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788658708.586721:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:19635:x1875544103832832:12345-0@lo:253:mount.lustre.0 Request processed in 26164us (26513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658708.586740:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788658708.586858:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103832832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658708.586893:0:19635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788658708.586896:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658708.586898:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788658708.586900:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658708.586901:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658708.586902:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658708.586903:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658708.586904:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658708.586905:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658708.586907:0:19635:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658708.586933:0:19635:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56d183a800 from lustre-OST0000 10000000:01000000:2.0:1788658708.586962:0:19635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788658708.586966:0:19635:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658708.586973:0:19635:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56fb3b8000 local copy 00010000:00010000:2.0:1788658708.586985:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658708.587238:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103832960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658708.587274:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.587321:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658708.587406:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103832960 00000100:00100000:3.0:1788658708.587414:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103832960 00000100:00100000:3.0:1788658708.587471:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788658708.587481:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:19635:x1875544103832960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658708.587644:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:19635:x1875544103832960:12345-0@lo:501:mount.lustre.0 Request processed in 159us (363us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788658708.587652:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788658708.587716:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103832960:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788658708.587734:0:19635:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788658708.587912:0:19635:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788658708.587920:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.587929:0:19635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788658708.587949:0:19635:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56d183a800 10000000:01000000:1.0:1788658708.587954:0:19635:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788658708.587958:0:19635:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9e56fb3b8000 10000000:01000000:1.0:1788658708.587961:0:19635:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788658708.587964:0:19635:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9e56fb3b8000 from 1 10000000:01000000:1.0:1788658708.587967:0:19635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788658708.588199:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.588209:0:19635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.588219:0:19635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658708.588236:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658708.588270:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.588349:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658708.589170:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833088 00000100:00100000:0.0:1788658708.589179:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833088 00000100:00100000:0.0:1788658708.589238:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788658708.589248:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+12:19635:x1875544103833088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658708.589261:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658708.589280:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78000/0xf657f176650ec2bd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec2b6 expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.589306:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78000/0xf657f176650ec2bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec2b6 expref: 13 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.589317:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78000/0xf657f176650ec2bd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec2b6 expref: 13 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.589325:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78000, rc 0) 00000100:00100000:0.0:1788658708.589407:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+13:19635:x1875544103833088:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658708.589414:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788658708.589622:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658708.589640:0:19635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2bd expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.589650:0:19635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec2bd expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658708.589694:0:19635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788658708.589703:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2bd expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.589710:0:19635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007efe00/0xf657f176650ec2b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2bd expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658708.589717:0:19635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788658708.589722:0:19635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788658708.589728:0:19635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788658708.589730:0:19635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788658708.589751:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.589758:0:19635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.589766:0:19635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658708.589782:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658708.589812:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.589869:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.589937:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833216 00000100:00100000:1.0:1788658708.589942:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833216 00000100:00100000:1.0:1788658708.589976:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788658708.589983:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+13:19635:x1875544103833216:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658708.590010:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658708.590018:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed34600/0xf657f176650ec2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec2c4 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.590033:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed34600/0xf657f176650ec2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec2c4 expref: 14 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.590041:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed34600/0xf657f176650ec2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec2c4 expref: 14 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.590048:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34600, rc 0) 00000100:00100000:1.0:1788658708.590079:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833216:12345-0@lo:101:mount.lustre.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.590085:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788658708.590228:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658708.590240:0:19635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2cb expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.590247:0:19635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec2cb expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658708.591218:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788658708.593297:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658708.593806:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788658708.593860:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788658708.593897:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788658708.593949:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788658708.593987:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788658708.594538:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788658708.594596:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788658708.594636:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788658708.594704:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788658708.594756:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788658708.594796:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788658708.594841:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788658708.594906:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788658708.594914:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788658708.602185:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658708.602268:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.602316:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.602957:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833344 00000100:00100000:1.0:1788658708.602967:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833344 00000100:00100000:1.0:1788658708.603039:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788658708.603049:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658708.603523:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833344:12345-0@lo:501:mount.lustre.0 Request processed in 474us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.603531:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788658708.603570:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658708.603639:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658708.606007:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.606142:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c67dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658708.607604:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833472 00000100:00100000:2.0:1788658708.607621:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833472 00000100:00100000:2.0:1788658708.607809:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788658708.607822:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658708.608320:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833472:12345-0@lo:503:mount.lustre.0 Request processed in 500us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658708.608330:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788658708.608460:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658708.609365:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658708.609460:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658708.609518:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.610010:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788658708.610281:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833600 00000100:00100000:0.0:1788658708.610301:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833600 00000100:00100000:1.0:1788658708.610965:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788658708.610980:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658708.611372:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833600:12345-0@lo:502:mount.lustre.0 Request processed in 394us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.611381:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788658708.613959:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658708.614289:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788658708.614358:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788658708.614407:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788658708.614460:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788658708.614498:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788658708.614531:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788658708.614593:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788658708.614625:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788658708.614654:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788658708.614877:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788658708.614914:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788658708.614974:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788658708.615020:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658708.615092:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.615143:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.615438:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833728 00000100:00100000:1.0:1788658708.615456:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833728 00000100:00100000:1.0:1788658708.615520:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788658708.615531:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658708.616003:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833728:12345-0@lo:502:mount.lustre.0 Request processed in 472us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.616011:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788658708.616224:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658708.616321:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788658708.616335:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788658708.617633:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788658708.617644:0:19649:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788658708.617651:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.617653:0:19649:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788658708.617660:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788658708.617691:0:19649:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9e56e6ee4d40) 00000020:00000080:0.0:1788658708.617725:0:19649:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788658708.617731:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788658708.617908:0:19649:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56d183a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788658708.617916:0:19649:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788658708.617922:0:19649:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf657f176650ec2d9 00010000:00010000:1.0:1788658708.626068:0:19649:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788658708.630835:0:19649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:1.0:1788658708.632465:0:19649:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1788658708.638371:0:19649:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788658708.638386:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658708.638395:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638397:0:19649:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788658708.638400:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788658708.638413:0:19649:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788658708.638415:0:19649:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658708.638417:0:19649:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788658708.638419:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788658708.638422:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638424:0:19649:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788658708.638427:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658708.638429:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638431:0:19649:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788658708.638434:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788658708.638437:0:19649:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788658708.638439:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658708.638441:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638442:0:19649:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788658708.638444:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788658708.638446:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638447:0:19649:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788658708.638450:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788658708.638552:0:19649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788658708.638555:0:19649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788658708.638557:0:19649:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788658708.638560:0:19649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788658708.640363:0:19635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788658708.640417:0:19635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788658708.640441:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2cb expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.640453:0:19635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007ee200/0xf657f176650ec2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2cb expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658708.640462:0:19635:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56d183a800 from 1 10000000:01000000:2.0:1788658708.640465:0:19635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658708.640515:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.640524:0:19635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.640536:0:19635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658708.640564:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788658708.640638:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.640745:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.641737:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833856 00000100:00100000:1.0:1788658708.641750:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833856 00000100:00100000:1.0:1788658708.641819:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788658708.641829:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+14:19635:x1875544103833856:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658708.641847:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658708.641865:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec2e0 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.641893:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 15 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.641905:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 15 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.641914:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34200, rc 0) 00000100:00100000:1.0:1788658708.641987:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103833856:12345-0@lo:101:mount.lustre.0 Request processed in 159us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.641993:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788658708.642500:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788658708.642523:0:19635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.642562:0:19635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788658708.644389:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788658708.645002:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658708.645217:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788658708.645254:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788658708.645292:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788658708.645323:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788658708.645351:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788658708.645389:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788658708.645432:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788658708.645467:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788658708.645537:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788658708.645546:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788658708.645624:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658708.645712:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.645751:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.647957:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103833984 00000100:00100000:1.0:1788658708.647983:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103833984 00000100:00100000:1.0:1788658708.648055:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788658708.648065:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103833984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658708.648372:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103833984:12345-0@lo:501:mount.lustre.0 Request processed in 307us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.648380:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788658708.648515:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103833984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658708.648568:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658708.648614:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.648655:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658708.650683:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834112 00000100:00100000:3.0:1788658708.650700:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834112 00000100:00100000:3.0:1788658708.650832:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658708.650844:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788658708.651081:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834112:12345-0@lo:503:mount.lustre.0 Request processed in 239us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.651089:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788658708.652267:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834112:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788658708.653636:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788658708.653954:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834240:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658708.654472:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.654527:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658708.654593:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834240 00000100:00100000:0.0:1788658708.654601:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834240 00000100:00100000:0.0:1788658708.654653:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788658708.654685:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658708.654918:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834240:12345-0@lo:502:mount.lustre.0 Request processed in 255us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658708.654926:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788658708.655280:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834240:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658708.655574:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788658708.655630:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788658708.655710:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788658708.655756:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788658708.655782:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788658708.655820:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788658708.655859:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788658708.655886:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788658708.655919:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834368:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658708.655969:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.656005:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658708.656144:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834368 00000100:00100000:2.0:1788658708.656150:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834368 00000100:00100000:2.0:1788658708.656198:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788658708.656205:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658708.656368:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834368:12345-0@lo:502:mount.lustre.0 Request processed in 163us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658708.656380:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788658708.656839:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788658708.656961:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788658708.656973:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788658708.661031:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658708.661049:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661052:0:19653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788658708.661059:0:19653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56d183a800 00000020:00000080:3.0:1788658708.661062:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658708.661069:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658708.661071:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661073:0:19653:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788658708.661075:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658708.661077:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661079:0:19653:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788658708.661082:0:19653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56d183a800 00000020:00000080:3.0:1788658708.661083:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658708.661165:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658708.661168:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661170:0:19653:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788658708.661171:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788658708.661174:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661175:0:19653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788658708.661178:0:19653:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56d183a800 00000020:00000080:3.0:1788658708.661179:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788658708.661212:0:19653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788658708.661216:0:19653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788658708.661218:0:19653:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788658708.661226:0:19653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788658708.670003:0:19635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788658708.670063:0:19635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658708.670095:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.670110:0:19635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658708.670170:0:19635:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658708.670173:0:19635:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56d183a800 10000000:01000000:0.0:1788658708.670177:0:19635:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56d183a800 10000000:01000000:0.0:1788658708.670182:0:19635:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658708.670189:0:19635:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56d183a800 from 1 10000000:01000000:0.0:1788658708.670191:0:19635:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658708.670228:0:19635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.670236:0:19635:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.670256:0:19635:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658708.670279:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834496:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658708.670351:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.675984:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658708.676135:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834496 00000100:00100000:3.0:1788658708.676145:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834496 00000100:00100000:3.0:1788658708.676257:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788658708.676269:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103834496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658708.676287:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658708.676308:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56deacce00/0xf657f176650ec2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec2ee expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.676338:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56deacce00/0xf657f176650ec2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec2ee expref: 16 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.676350:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56deacce00/0xf657f176650ec2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec2ee expref: 16 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.676359:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacce00, rc 0) 00000100:00100000:3.0:1788658708.676438:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834496:12345-0@lo:101:mount.lustre.0 Request processed in 171us (6086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.676445:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788658708.676935:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834496:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658708.676955:0:19635:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2f5 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.676966:0:19635:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec2f5 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658708.677565:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788658708.678161:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658708.678408:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788658708.678468:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788658708.678497:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788658708.678538:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788658708.678574:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788658708.678627:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788658708.678659:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788658708.678731:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788658708.678777:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788658708.678813:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788658708.678844:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788658708.678893:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788658708.678930:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788658708.678961:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788658708.679040:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788658708.679076:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788658708.679097:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788658708.679122:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788658708.679139:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788658708.679155:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788658708.679178:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788658708.679194:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788658708.679210:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788658708.679234:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788658708.679251:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788658708.679267:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788658708.679290:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788658708.679307:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788658708.679323:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788658708.679366:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788658708.679408:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788658708.679453:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788658708.679490:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788658708.679540:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788658708.679577:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788658708.679622:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788658708.679659:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788658708.679707:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788658708.679734:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788658708.679752:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788658708.679823:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788658708.679831:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788658708.679928:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658708.679992:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.682900:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.683107:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834624 00000100:00100000:1.0:1788658708.683117:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834624 00000100:00100000:1.0:1788658708.683168:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788658708.683177:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658708.684023:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834624:12345-0@lo:501:mount.lustre.0 Request processed in 840us (4023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.684034:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788658708.684534:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658708.684597:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658708.684642:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.684696:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677780 going to sleep for 11 seconds 00000100:00100000:1.0:1788658708.684861:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834752 00000100:00100000:1.0:1788658708.684867:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834752 00000100:00100000:1.0:1788658708.684901:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788658708.684909:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658708.685178:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834752:12345-0@lo:503:mount.lustre.0 Request processed in 267us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658708.685186:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788658708.686555:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834752:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658708.687196:0:19635:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658708.687280:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658708.687355:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.687408:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677780 going to sleep for 11 seconds 00000100:00100000:3.0:1788658708.687792:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103834880 00000100:00100000:3.0:1788658708.687801:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103834880 00000100:00100000:3.0:1788658708.687885:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788658708.687894:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658708.688114:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103834880:12345-0@lo:502:mount.lustre.0 Request processed in 221us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.688121:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788658708.689873:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103834880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658708.690195:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788658708.692746:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788658708.692829:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788658708.692908:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788658708.692945:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788658708.692992:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788658708.693028:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788658708.693062:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788658708.693111:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788658708.693142:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788658708.693174:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788658708.693224:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788658708.693262:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788658708.693294:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788658708.693344:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788658708.693379:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788658708.693411:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788658708.693479:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788658708.693536:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788658708.693582:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788658708.693633:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788658708.693710:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788658708.693747:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788658708.693794:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788658708.693829:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1788658708.693862:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1788658708.693916:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1788658708.693961:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1788658708.693997:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1788658708.694045:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1788658708.702607:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1788658708.702737:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1788658708.702778:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1788658708.702874:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1788658708.702934:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1788658708.702984:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1788658708.703018:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1788658708.703050:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1788658708.703097:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1788658708.703133:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1788658708.703190:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103835008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658708.703286:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.703337:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5677780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658708.703768:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835008 00000100:00100000:2.0:1788658708.703781:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835008 00000100:00100000:2.0:1788658708.703839:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788658708.703850:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103835008:12345-0@lo:502:mount.lustre.0 00010000:00010000:1.0:1788658708.705755:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658708.706026:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103835008:12345-0@lo:502:mount.lustre.0 Request processed in 2170us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658708.706041:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788658708.717787:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103835008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658708.718086:0:19635:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788658708.718103:0:19635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788658708.723653:0:19658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788658708.725054:0:19658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9e56c8914d40) 00000020:00000080:2.0:1788658708.725090:0:19658:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788658708.725204:0:19658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56d183a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788658708.725209:0:19658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56d183a800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788658708.725211:0:19658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56d183a800 3 00010000:00080000:2.0:1788658708.725244:0:19658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e56deaaa000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1788658708.729176:0:19658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788658708.729387:0:19658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788658708.729426:0:19658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788658708.729440:0:19658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf657f176650ec303 00000100:00080000:2.0:1788658708.729450:0:19658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788658708.729456:0:19658:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9e56deaaa000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658708.729510:0:19658:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd8000 x1875544103835136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788658708.729540:0:19658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788658708.729806:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658708.729812:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658708.729826:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658708.729830:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658708.730074:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788658708.730094:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103835264:0@lo:400:kworker.0 00000100:00100000:3.0:1788658708.730170:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.730221:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835264 00000100:00100000:3.0:1788658708.730229:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835264 00000100:00100000:3.0:1788658708.730278:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658708.730288:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103835264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658708.730364:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103835264:12345-0@lo:400:kworker.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.730372:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788658708.730416:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5d880 x1875544103835264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658708.730430:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103835264:0@lo:400:kworker.0 00000100:00100000:0.0:1788658708.730571:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103835136:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788658708.730608:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658708.730661:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835136 00000100:00100000:0.0:1788658708.730700:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835136 00000100:00100000:0.0:1788658708.730724:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658708.730730:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103835136:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658708.730754:0:18952:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:0.0:1788658708.730791:0:18952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf657f176650ec30a 00000004:00100000:0.0:1788658708.730807:0:18952:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658708.730839:0:18952:0:(import.c:65:import_set_state_nolock()) ffff9e57006ce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658708.730884:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875544103835136:12345-0@lo:38:llog_process_th.0 Request processed in 153us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658708.730891:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788658708.731042:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56fefd8000 x1875544103835136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658708.731051:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658708.731058:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788658708.731066:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658708.731077:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658708.731080:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56deaaa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658708.731087:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875544103835136:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788658708.733866:0:19658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:1.0:1788658708.734982:0:19635:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788658708.735023:0:19635:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788658708.735046:0:19635:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2f5 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.735059:0:19635:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac79200/0xf657f176650ec2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec2f5 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788658708.735130:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788658708.735133:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658708.735134:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658708.735136:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658708.735137:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658708.735139:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658708.735141:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658708.735143:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658708.735144:0:19635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658708.735149:0:19635:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788658708.735152:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788658708.735153:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658708.735154:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658708.735155:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658708.735157:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658708.735158:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658708.735160:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658708.735161:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658708.735162:0:19635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788658708.735279:0:19635:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788658708.735302:0:19635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103835392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788658708.735386:0:19635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658708.735435:0:19635:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788658708.735792:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835392 00000100:00100000:2.0:1788658708.735802:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835392 00000100:00100000:2.0:1788658708.735864:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788658708.735874:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:19635:x1875544103835392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788658708.735904:0:18945:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788658708.735917:0:18945:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788658708.784523:0:18945:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788658708.784547:0:18945:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788658708.784582:0:18967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788658708.784589:0:18967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788658708.784615:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.784638:0:18967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec277 expref: 16 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.784646:0:18967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.784728:0:18967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 16 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658708.784743:0:18967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 16 pid: 18945 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658708.784757:0:18967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103835520:0@lo:104: 00000100:00100000:2.0:1788658708.784958:0:18967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658708.785002:0:18967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56f454ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788658708.785146:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835520 00000100:00100000:0.0:1788658708.785155:0:18935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835520 00000100:00100000:0.0:1788658708.785206:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658708.785215:0:18935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103835520:12345-0@lo:104: 00010000:00010000:0.0:1788658708.785231:0:18935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785295:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658708.785302:0:18935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103835520:12345-0@lo:104: Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658708.785310:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788658708.785333:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658708.785339:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785347:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc400 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658708.785351:0:18939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785373:0:18939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658708.785379:0:18939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658708.785385:0:18939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658708.785414:0:18939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785420:0:18939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658708.785441:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785448:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec27e expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658708.785467:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658708.785469:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658708.785470:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658708.785484:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103835648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658708.785530:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658708.785555:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835648 00000100:00100000:3.0:1788658708.785561:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835648 00000100:00100000:1.0:1788658708.785582:0:18967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103835520:0@lo:104: 00010000:00010000:3.0:1788658708.785583:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 17 pid: 18945 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.785607:0:18967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658708.785615:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658708.785622:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:3307:x1875544103835648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658708.785633:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658708.785638:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 17 pid: 18945 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785655:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 17 pid: 18945 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785692:0:18938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007eec00/0xf657f176650ec27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec277 expref: 17 pid: 18945 timeout: 699 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785704:0:18938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785712:0:18938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788658708.785724:0:18938:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001137282s 00010000:00010000:3.0:1788658708.785729:0:18938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785736:0:18938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785743:0:18938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785749:0:18938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785754:0:18938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658708.785758:0:18938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785765:0:18938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785790:0:18938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.785797:0:18967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658708.785800:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658708.785804:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658708.785821:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ef400/0xf657f176650ec311 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658708.785830:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3307:x1875544103835648:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.785836:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658708.786113:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103835648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658708.821186:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:19635:x1875544103835392:12345-0@lo:253:mount.lustre.0 Request processed in 85303us (85790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658708.821204:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788658708.821232:0:19635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:19635:1875544103835392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788658708.821253:0:19635:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788658708.821257:0:19635:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788658708.821259:0:19635:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788658708.821261:0:19635:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788658708.821262:0:19635:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788658708.821263:0:19635:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788658708.821265:0:19635:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788658708.821266:0:19635:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788658708.821268:0:19635:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788658708.821270:0:19635:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788658708.821291:0:19635:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788658708.822041:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788658708.822181:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788658708.822313:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788658708.822591:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788658708.822783:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788658708.823296:0:19635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788658708.824789:0:19635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788658708.869442:0:19635:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788658708.869467:0:19635:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788658708.869511:0:19635:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788658708.871960:0:19635:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788658708.872004:0:19635:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788658708.872044:0:19635:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788658709.727893:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788658709.987466:0:18948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788658709.987476:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56eee1b000 from 10 10000000:01000000:2.0:1788658709.987482:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788658709.987535:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.987559:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.987572:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658709.987601:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103835776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658709.988103:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658709.988152:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6fb46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658709.988174:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835776 00000100:00100000:2.0:1788658709.988181:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835776 00000100:00100000:2.0:1788658709.988479:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788658709.988490:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+15:18948:x1875544103835776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658709.988505:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658709.988522:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec318 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.988548:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec318 expref: 16 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.988561:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec318 expref: 16 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.988571:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57007ee000, rc 0) 00000100:00100000:2.0:1788658709.988685:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:18948:x1875544103835776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658709.988693:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788658709.992357:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103835776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658709.992392:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658709.992405:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658709.992475:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103835904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788658709.992547:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658709.992598:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c92baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658709.992902:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103835904 00000100:00100000:2.0:1788658709.992911:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103835904 00000100:00100000:2.0:1788658709.992964:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658709.992975:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:18948:x1875544103835904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788658709.993000:0:18943:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788658709.993017:0:18943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788658709.993020:0:18943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788658709.993111:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:18948:x1875544103835904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 138us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658709.993119:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788658709.993161:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103835904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788658709.993218:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788658709.993227:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658709.993235:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658710.755725:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658711.772917:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658712.797655:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658713.824084:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658714.013779:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658714.013786:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658714.013789:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658714.013792:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788658714.013864:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103836288:0@lo:400:kworker.0 00000100:00100000:3.0:1788658714.013885:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3304:1875544103836032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658714.013988:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658714.014042:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658714.014048:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103836160:0@lo:400:kworker.0 00000100:00100000:3.0:1788658714.014073:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658714.014130:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836032 00000100:00100000:2.0:1788658714.014139:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836032 00000100:00100000:2.0:1788658714.014182:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788658714.014191:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3304:x1875544103836032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658714.014244:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3304:x1875544103836032:12345-0@lo:400:kworker.0 Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658714.014252:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788658714.014254:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836160 00000100:00100000:3.0:1788658714.014258:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836160 00000100:00100000:3.0:1788658714.014285:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788658714.014291:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103836160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658714.014321:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3304:1875544103836032:0@lo:400:kworker.0 00000100:00100000:3.0:1788658714.014368:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103836160:12345-0@lo:400:kworker.0 Request processed in 76us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658714.014375:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788658714.014868:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658714.014956:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836288 00000100:00100000:0.0:1788658714.014962:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836288 00000100:00100000:0.0:1788658714.014995:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658714.015003:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103836288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658714.015036:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103836288:12345-0@lo:400:kworker.0 Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658714.015042:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788658714.015080:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788658714.015165:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5f480 x1875544103836288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788658714.015178:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103836288:0@lo:400:kworker.0 00010000:00080000:2.0:1788658714.016038:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5f800 x1875544103836160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658714.016051:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103836160:0@lo:400:kworker.0 00010000:00010000:2.0:1788658714.844957:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658715.617282:0:20003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788658715.868743:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658716.892797:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658717.278836:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788658717.917838:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658718.943566:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788658719.132951:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658719.132960:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788658719.132964:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658719.132968:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788658719.133034:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103836544:0@lo:400:kworker.0 00000100:00100000:3.0:1788658719.133172:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658719.133258:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658719.133265:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103836672:0@lo:400:kworker.0 00000100:00100000:3.0:1788658719.133305:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658719.133363:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836544 00000100:00100000:0.0:1788658719.133606:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788658719.133608:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836544 00000100:00100000:0.0:1788658719.133642:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103836416:0@lo:400:kworker.0 00000100:00100000:0.0:1788658719.133761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658719.133822:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836672 00000100:00100000:0.0:1788658719.133830:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836672 00000100:00100000:3.0:1788658719.133861:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658719.133877:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103836544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658719.133888:0:18953:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788658719.133899:0:18953:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788658719.133941:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836416 00000100:00100000:0.0:1788658719.133946:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836416 00000100:00100000:3.0:1788658719.133966:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103836544:12345-0@lo:400:kworker.0 Request processed in 92us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658719.133976:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658719.134005:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658719.134012:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103836672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658719.134044:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103836672:12345-0@lo:400:kworker.0 Request processed in 34us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658719.134051:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788658719.134214:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5d180 x1875544103836672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658719.134232:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103836672:0@lo:400:kworker.0 00010000:00080000:3.0:1788658719.134249:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5c700 x1875544103836544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658719.134257:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103836544:0@lo:400:kworker.0 00000100:00080000:1.0:1788658719.134861:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658719.134913:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658719.134930:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3306:x1875544103836416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658719.134996:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3306:x1875544103836416:12345-0@lo:400:kworker.0 Request processed in 73us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658719.135004:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788658719.135315:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103836416:0@lo:400:kworker.0 00010000:00010000:0.0:1788658719.977074:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658720.988824:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658705/real 1788658705] req@ffff9e57007e3100 x1875544103832448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658720.988863:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e57007e3100 x1875544103832448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788658720.988869:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658720.988874:0:3303:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788658705/real 1788658705] req@ffff9e57007e1880 x1875544103832576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658720.988885:0:3303:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9e57007e1880 x1875544103832576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788658720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788658720.988908:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e57006cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658720.988934:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658720.988939:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103832448:0@lo:8:kworker.0 00000100:00080000:1.0:1788658720.988946:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658720.988950:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788658720.988977:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103832576:0@lo:8:kworker.0 00000100:00080000:3.0:1788658720.989079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658720.989085:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788658720.989089:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e57006cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658720.989095:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:3.0:1788658720.989102:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788658720.989109:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9e57006cd800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658720.989134:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56eec5d180 x1875544103836928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788658720.989164:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788658720.989167:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788658720.989169:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788658720.989172:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 596 00000100:00080000:3.0:1788658720.989175:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788658720.989179:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103836800:0@lo:400:kworker.0 00000100:00080000:3.0:1788658720.989180:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183b000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1788658720.989193:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56eec5c380 x1875544103837056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788658720.989246:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103837312:0@lo:400:kworker.0 00000100:00100000:0.0:1788658720.989334:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103837184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658720.989368:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103836928:0@lo:8:kworker.0 00000100:00100000:3.0:1788658720.990308:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658720.990314:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658720.990503:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836800 00000100:00100000:1.0:1788658720.990513:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836800 00000100:00100000:1.0:1788658720.990982:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658720.991008:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3306:x1875544103836800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658720.991097:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:3306:x1875544103836800:12345-0@lo:400:kworker.0 Request processed in 93us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658720.991105:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788658720.991169:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103836800:0@lo:400:kworker.0 00000100:00100000:3.0:1788658720.991337:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837312 00000100:00100000:3.0:1788658720.991345:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837312 00000100:00100000:3.0:1788658720.991398:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658720.991416:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103837312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658720.991464:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103837312:12345-0@lo:400:kworker.0 Request processed in 60us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658720.991472:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788658720.991506:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5c000 x1875544103837312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658720.991519:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103837312:0@lo:400:kworker.0 00000100:00100000:3.0:1788658720.991806:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658720.991894:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837184 00000100:00100000:0.0:1788658720.991900:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837184 00000100:00100000:0.0:1788658720.991950:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788658720.991958:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103837184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658720.992002:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875544103837184:12345-0@lo:400:kworker.0 Request processed in 45us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658720.992026:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788658720.992159:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5ea00 x1875544103837184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788658720.992169:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875544103837184:0@lo:400:kworker.0 00000100:00100000:2.0:1788658720.993977:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658720.994035:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103837056:0@lo:8:kworker.0 00000100:00100000:2.0:1788658720.994060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658720.994314:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103836928 00000100:00100000:3.0:1788658720.994324:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103836928 00000100:00100000:3.0:1788658720.994361:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837056 00000100:00100000:3.0:1788658720.994364:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837056 00000100:00100000:3.0:1788658720.994375:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658720.994381:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103836928:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788658720.994420:0:19637:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:3.0:1788658720.994462:0:19637:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ec326 00002000:00100000:3.0:1788658720.994482:0:19637:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9e56fc6a0000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788658720.994487:0:19637:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788658720.994490:0:19637:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788658720.994981:0:19637:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788658720.995019:0:19637:0:(import.c:65:import_set_state_nolock()) ffff9e56fc6a5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658720.995088:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103836928:12345-0@lo:8:kworker.0 Request processed in 705us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658720.995096:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788658720.995117:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788658720.995122:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103837056:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788658720.995135:0:19637:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788658720.996649:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e56eec5d180 x1875544103836928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658720.996687:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658720.996699:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788658720.996710:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788658720.996717:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788658720.996720:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e57006cd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788658720.996740:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788658720.996745:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103836928:0@lo:8:kworker.0 00000004:00080000:1.0:1788658720.996818:0:18974:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:1.0:1788658720.996836:0:18974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18974:1875544103837568:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788658720.996897:0:18974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658720.996930:0:18974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56cacf1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788658720.996943:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103837440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658720.996982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658720.997029:0:19640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837440 00000100:00100000:1.0:1788658720.997037:0:19640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837440 00000100:00100000:1.0:1788658720.997087:0:19640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658720.997096:0:19640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103837440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658720.997132:0:19640:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658720.997169:0:19640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103837440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658720.997174:0:19640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788658720.997191:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788658720.997207:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57007e1880 x1875544103837440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658720.997220:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103837440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788658720.997330:0:19639:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658720.997339:0:19639:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788658720.997425:0:19638:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788658720.997440:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837568 00000100:00100000:0.0:1788658720.997444:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837568 00000004:00080000:0.0:1788658720.997480:0:18973:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788658720.997902:0:18973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 612137236188ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788658720.998106:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658720.998116:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18974:x1875544103837568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788658721.010482:0:20273:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788658721.010496:0:20273:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788658721.010502:0:20273:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:1.0:1788658721.028429:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.028446:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.028469:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.028474:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.028481:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.028511:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.028522:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.028528:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.028548:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.028621:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.028630:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.028640:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.028646:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.028657:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.029099:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.029110:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec32d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.029136:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.029138:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.029140:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.029225:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.029231:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029239:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.029242:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.029247:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029270:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029280:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029299:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029317:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658721.029327:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658721.029331:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029339:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658721.029342:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029349:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029360:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029367:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec334 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.029380:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.029382:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.029384:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.030449:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.030465:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.030476:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.030479:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.030483:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.030491:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.030498:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.030504:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.030519:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.030547:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.030569:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.030578:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34e00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.030582:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.030591:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.030605:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.030613:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b714c8c/0xf657f176650ec33b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.030631:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.030634:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.030635:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.033512:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.033530:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.033550:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.033556:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.033563:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.033580:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.033601:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.033610:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.033647:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.033975:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.033984:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.033993:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.033999:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.034028:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.034047:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.034055:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec342 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.034083:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.034084:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.034086:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.036614:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.036631:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.036649:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.036654:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.036660:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788658721.037318:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788658721.037583:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037598:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037606:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037644:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658721.037695:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658721.037702:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037711:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658721.037716:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037739:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037760:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037768:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec349 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.037792:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.037799:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.037801:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.038777:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.038786:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.038800:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.038812:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.038818:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658721.038834:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103837056:12345-0@lo:8:kworker.0 Request processed in 43704us (44765us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788658721.038848:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788658721.039172:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.039183:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.039189:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.041799:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658721.041817:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.041828:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.041844:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.041850:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.041877:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.041919:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.041928:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec350 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.041959:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.041962:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.041963:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658721.043433:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.043446:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.043465:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.043471:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.043479:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.043494:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.043519:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.043528:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.043565:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658721.044225:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.044232:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044243:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.044247:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.044252:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044263:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044284:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044293:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044326:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788658721.044345:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658721.044351:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044360:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.044366:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044377:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044395:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.044404:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224f4e57/0xf657f176650ec357 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.044560:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.046780:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.046788:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.046790:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788658721.047076:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658721.047089:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788658721.047096:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103837056:0@lo:8:kworker.0 00010000:00010000:2.0:1788658721.047366:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.047370:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.047372:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.047997:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.048015:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79e00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658721.048021:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.048035:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.048079:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.048087:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc004a72/0xf657f176650ec35e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.048112:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.048114:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658721.048117:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658721.049419:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.049433:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.049453:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.049465:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.049474:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.049492:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.049505:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.049514:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.050523:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658721.051796:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.051810:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.051829:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.051834:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.051841:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.051857:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.051870:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.051885:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052083:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658721.052093:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052102:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.052108:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052118:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052163:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052171:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fed843b/0xf657f176650ec365 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052195:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.052199:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052205:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.052208:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052215:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052224:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.052231:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.052233:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.052235:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.052517:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658721.052524:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7e76714/0xf657f176650ec36c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658721.053168:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.053176:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.053189:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.053193:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.053198:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.053209:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.053218:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.053226:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.058219:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.058239:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.058272:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.058290:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.058307:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.058337:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.058350:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.058352:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.058353:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.058432:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788658721.058476:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.058605:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064eac4a2/0xf657f176650ec373 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658721.059874:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.059885:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.059902:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.059908:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.059974:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.059994:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060069:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060079:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060142:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788658721.060590:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.060597:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060613:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.060617:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.060622:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060634:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060642:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.060649:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060780:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658721.060790:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060799:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.060805:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060816:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060833:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060848:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b9c123/0xf657f176650ec37a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060868:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.060871:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060878:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.060881:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060889:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060901:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.060908:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.060910:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.060912:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.061089:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658721.061095:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015648c6d/0xf657f176650ec381 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788658721.061567:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.061574:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.061585:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.061589:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.061593:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.061615:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.061626:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.061633:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.061749:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.061756:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.061764:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.061774:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.061783:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.061796:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.061805:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.061806:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.061808:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.061860:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788658721.061865:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023bf75b7/0xf657f176650ec388 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.061890:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788658721.062510:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788658721.062518:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.062529:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=612s v=(0 0) 00010000:00010000:0.0:1788658721.062533:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658721.062538:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.062549:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.062569:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.062578:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.063494:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658721.063872:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.063883:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.063897:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.063903:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658721.064361:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.064374:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.064392:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.064398:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.064405:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.064420:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.064431:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.064453:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.064479:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788658721.065031:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.065036:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065045:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.065048:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.065052:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065061:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065070:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065077:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065102:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658721.065194:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658721.065205:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065218:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.065224:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065254:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065294:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065304:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec396 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065344:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.065350:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065359:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.065364:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065373:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065384:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065393:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec39d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.065539:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.065542:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.065546:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.065589:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.065597:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065612:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.065615:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.065620:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065631:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065639:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065646:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.065724:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.065997:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.066004:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066013:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35e00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.066018:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066027:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066040:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066047:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009099ef0/0xf657f176650ec3a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066068:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.066070:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.066073:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.066151:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.066158:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066167:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.066170:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.066174:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066184:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066203:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066211:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066228:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.066257:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.066264:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066298:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.066304:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066313:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066329:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066339:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d82bb46/0xf657f176650ec3ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.066361:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.066364:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.066367:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.066784:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.066792:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066803:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.066808:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.066812:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066822:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066832:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066840:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.066874:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.066969:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.066979:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.066989:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.066995:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.067006:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.067022:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.067031:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.067058:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.067069:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.067073:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.067357:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.067379:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.067386:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d26c93/0xf657f176650ec38f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.067419:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.067421:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.067423:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.067726:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.068810:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.068820:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.068834:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.068838:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.068843:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.068927:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.068937:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.068946:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.069055:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.069529:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.069537:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.069547:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.069551:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.069560:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.069577:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.069585:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.069606:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.069608:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.069610:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658721.071522:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658721.071535:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.071551:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=612s v=(0 0) 00010000:00010000:3.0:1788658721.071555:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658721.071561:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.071573:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.071594:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.071602:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.071938:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658721.072040:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.072057:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.072072:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacca00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.072079:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.072095:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.072120:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.072129:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983b9076/0xf657f176650ec3c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.072158:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.072161:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.072162:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788658721.072995:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788658721.073004:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.073015:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=612s v=(0 0) 00010000:00010000:3.0:1788658721.073019:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788658721.073023:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.073035:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.073044:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.073053:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.073219:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.073462:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.073471:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.073479:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.073489:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.073500:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.073518:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.073526:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b354ebd/0xf657f176650ec3c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.073545:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.073547:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.073549:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.074587:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.074601:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.074619:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.074632:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.074640:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.074655:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.074702:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.074713:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.074736:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.074992:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.075004:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075017:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.075021:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075032:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075047:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075055:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a05755/0xf657f176650ec3ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075090:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.075092:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.075094:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.075236:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.075245:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075257:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.075261:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.075265:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075276:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075285:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075314:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075344:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.075498:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.075506:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075515:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.075532:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075541:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075559:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075566:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0c6974/0xf657f176650ec3d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.075601:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.075603:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.075605:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.075912:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.075920:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075930:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.075934:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.075939:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075949:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075956:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075963:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.075984:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.076284:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.076302:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076312:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.076317:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076328:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076344:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788658721.076442:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.076450:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.076467:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.076470:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.076474:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.076484:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.076492:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.076499:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.076536:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.076778:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8827dd1/0xf657f176650ec3dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076802:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.076809:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076816:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.076819:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076827:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076838:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.076845:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005837b011/0xf657f176650ec3e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.076969:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.076974:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.076978:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.077023:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.077026:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.077031:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.077055:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.077064:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.077074:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.077078:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.077083:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.077093:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.077116:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.077125:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.077150:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.077244:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.077251:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.077270:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.077274:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.077282:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.077305:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.077312:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f29295/0xf657f176650ec3ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.077328:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.077330:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.077331:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.081091:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.081109:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.081130:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.081135:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.081144:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.081163:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.081175:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.081184:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.081227:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658721.081264:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658721.081279:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.081303:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658721.081309:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.081323:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.081366:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.081375:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c301e874/0xf657f176650ec3f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658721.081409:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.081411:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658721.081413:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.082763:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.082775:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.082791:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.082795:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.082801:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.082815:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.082826:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.082835:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.082858:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658721.082891:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658721.082902:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.082914:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658721.082919:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.082931:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.082980:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.082989:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057542f9a/0xf657f176650ec3f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658721.083013:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.083015:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658721.083017:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788658721.084699:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788658721.084712:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.084728:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=612s v=(0 0) 00010000:00010000:1.0:1788658721.084741:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658721.084748:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.084765:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.084777:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.084785:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658721.084815:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658721.084842:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658721.084853:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.084950:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658721.084956:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.084968:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.084986:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.084994:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000854b18b1/0xf657f176650ec3ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658721.085018:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.085020:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658721.085022:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788658721.087261:0:20273:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:1.0:1788658721.087412:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18974:x1875544103837568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 89291us (90508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658721.087424:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658721.088801:0:18974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18974:1875544103837568:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658721.088877:0:18974:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788658721.088935:0:18974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18974:1875544103837696:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788658721.089193:0:18974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658721.089296:0:18974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c5675780 going to sleep for 11 seconds 00000100:00100000:0.0:1788658721.089357:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837696 00000100:00100000:0.0:1788658721.089364:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837696 00000100:00100000:0.0:1788658721.090417:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658721.090433:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18974:x1875544103837696:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788658721.090490:0:19638:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:1.0:1788658721.095184:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18974:x1875544103837696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4738us (5973us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788658721.095200:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658721.095365:0:18974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18974:1875544103837696:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788658721.095383:0:18974:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:0.0:1788658722.018578:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788658722.376074:0:20355:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788658722.376078:0:20355:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788658722.376236:0:20355:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9e56deaab000 00000020:01000004:2.0:1788658722.376254:0:20355:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788658722.376268:0:20355:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788658722.376281:0:20355:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9e56c8910000) 00000020:00000080:2.0:1788658722.376298:0:20355:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788658722.403006:0:20355:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788658722.405555:0:20355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788658722.407220:0:20355:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788658722.407506:0:20355:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788658722.408204:0:20355:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788658722.408556:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1788658722.410145:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1788658722.410255:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1788658722.410727:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 312: rc = 0 00100000:10000000:3.0:1788658722.411061:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 312: rc = 0 00100000:10000000:3.0:1788658722.411351:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 312: rc = 0 00100000:10000000:3.0:1788658722.412810:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 312: rc = 0 00100000:10000000:3.0:1788658722.413710:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 312: rc = 0 00100000:10000000:3.0:1788658722.413995:0:20355:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 312: rc = 0 00000020:00000080:3.0:1788658722.414572:0:20355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788658722.414586:0:20355:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788658722.414603:0:20355:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ec40d 00000020:01000004:3.0:1788658722.414612:0:20355:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788658722.414635:0:20355:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788658722.414639:0:20355:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788658722.414646:0:20355:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788658722.414710:0:20355:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788658722.414715:0:20355:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788658722.439068:0:20355:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788658722.439117:0:20355:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.103@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788658722.439122:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788658722.439123:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658722.439125:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658722.439126:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658722.439128:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658722.439129:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658722.439130:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658722.439132:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658722.439133:0:20355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658722.439137:0:20355:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788658722.439139:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788658722.439141:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658722.439142:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658722.439143:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658722.439145:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658722.439146:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658722.439147:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658722.439148:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658722.439149:0:20355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788658722.439199:0:20355:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788658722.439225:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103837824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788658722.439315:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.439380:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbacae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.439606:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837824 00000100:00100000:0.0:1788658722.439615:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837824 00000100:00100000:0.0:1788658722.439703:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788658722.439713:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:20355:x1875544103837824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788658722.439746:0:18946:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788658722.439750:0:18946:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788658722.439754:0:18946:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788658722.452951:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:20355:x1875544103837824:12345-0@lo:253:mount.lustre.0 Request processed in 13226us (13622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.452969:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788658722.453060:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103837824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788658722.453077:0:20355:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788658722.453095:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788658722.453098:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788658722.453100:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788658722.453101:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788658722.453102:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788658722.453104:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788658722.453105:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788658722.453107:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788658722.453108:0:20355:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788658722.453136:0:20355:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9e56deaab000 from lustre-OST0001 10000000:01000000:2.0:1788658722.453175:0:20355:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788658722.453179:0:20355:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788658722.453188:0:20355:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9e56fb3b8000 local copy 00010000:00010000:2.0:1788658722.453201:0:20355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658722.453450:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103837952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658722.453569:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.453774:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbacaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.453827:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103837952 00000100:00100000:1.0:1788658722.453835:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103837952 00000100:00100000:1.0:1788658722.453991:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788658722.454001:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:20355:x1875544103837952:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788658722.454253:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:20355:x1875544103837952:12345-0@lo:501:mount.lustre.0 Request processed in 252us (683us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658722.454272:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788658722.454350:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103837952:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788658722.454366:0:20355:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788658722.454546:0:20355:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788658722.454555:0:20355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.454566:0:20355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacd400/0xf657f176650ec19e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec1a5 expref: -99 pid: 18933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658722.454844:0:20355:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9e56deaab000 10000000:01000000:3.0:1788658722.454850:0:20355:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788658722.454856:0:20355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788658722.454858:0:20355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788658722.454932:0:20355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788658722.454935:0:20355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788658722.454966:0:20355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.454975:0:20355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.454992:0:20355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658722.455011:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658722.455054:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658722.455159:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.455310:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838080 00000100:00100000:1.0:1788658722.455317:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838080 00000100:00100000:1.0:1788658722.455359:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788658722.455368:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:20355:x1875544103838080:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788658722.455379:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658722.455392:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed34000/0xf657f176650ec41b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec414 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.455413:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed34000/0xf657f176650ec41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec414 expref: 17 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.455424:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed34000/0xf657f176650ec41b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec414 expref: 17 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.455432:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34000, rc 0) 00000100:00100000:3.0:1788658722.455605:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838080:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658722.455619:0:20355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec41b expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.455629:0:20355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec41b expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658722.456987:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838080:12345-0@lo:101:mount.lustre.0 Request processed in 1612us (1924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658722.456998:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:3.0:1788658722.457579:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788658722.459489:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788658722.460057:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788658722.460104:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788658722.460135:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788658722.460191:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788658722.460229:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788658722.460259:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788658722.460300:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788658722.460333:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788658722.460380:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788658722.460444:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788658722.460452:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788658722.460748:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658722.460823:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.461050:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.461177:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838208 00000100:00100000:3.0:1788658722.461185:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838208 00000100:00100000:3.0:1788658722.461271:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788658722.461282:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658722.461811:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838208:12345-0@lo:501:mount.lustre.0 Request processed in 528us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.461820:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788658722.461916:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838208:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658722.461956:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658722.462002:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.462197:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca540 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.462266:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838336 00000100:00100000:1.0:1788658722.462272:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838336 00000100:00100000:1.0:1788658722.462299:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788658722.462306:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838336:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658722.463660:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838336:12345-0@lo:503:mount.lustre.0 Request processed in 1344us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658722.463691:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788658722.463984:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838336:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658722.465081:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658722.465186:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658722.465251:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.465287:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.465385:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838464 00000100:00100000:3.0:1788658722.465392:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838464 00000100:00100000:3.0:1788658722.465432:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788658722.465442:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658722.465685:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838464:12345-0@lo:502:mount.lustre.0 Request processed in 243us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.465699:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788658722.465982:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658722.466224:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788658722.466276:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788658722.466317:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788658722.466368:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788658722.466405:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788658722.466441:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788658722.466508:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788658722.466550:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788658722.467008:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788658722.467047:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658722.467112:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.467150:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca540 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.467216:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838592 00000100:00100000:3.0:1788658722.467223:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838592 00000100:00100000:3.0:1788658722.467308:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788658722.467318:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788658722.467505:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838592:12345-0@lo:502:mount.lustre.0 Request processed in 188us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.467514:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788658722.467798:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658722.467880:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788658722.467891:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788658722.468963:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788658722.468973:0:20356:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788658722.468981:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.468984:0:20356:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788658722.468992:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788658722.469006:0:20356:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9e56c89119c0) 00000020:00000080:2.0:1788658722.469031:0:20356:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788658722.469037:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788658722.469107:0:20356:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56deaab000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788658722.469116:0:20356:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788658722.469123:0:20356:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf657f176650ec429 00010000:00010000:2.0:1788658722.475217:0:20356:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788658722.477845:0:20356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788658722.480300:0:20356:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788658722.481859:0:20356:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788658722.481872:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658722.481987:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.481990:0:20356:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788658722.481995:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658722.482000:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.482001:0:20356:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788658722.482004:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788658722.482006:0:20356:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788658722.482009:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658722.482011:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.482012:0:20356:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788658722.482015:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788658722.482017:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.482018:0:20356:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788658722.482022:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788658722.482080:0:20356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788658722.482083:0:20356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788658722.482085:0:20356:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788658722.482088:0:20356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788658722.482267:0:20355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788658722.482297:0:20355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788658722.482320:0:20355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec41b expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.482333:0:20355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacca00/0xf657f176650ec414 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec41b expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658722.482342:0:20355:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56deaab000 from 1 10000000:01000000:3.0:1788658722.482344:0:20355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658722.482382:0:20355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.482391:0:20355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.482402:0:20355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658722.482428:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788658722.482522:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658722.482572:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.482711:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838720 00000100:00100000:0.0:1788658722.482719:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838720 00000100:00100000:0.0:1788658722.482765:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788658722.482776:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:20355:x1875544103838720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658722.482797:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658722.482811:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec430 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.482836:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.482847:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.482856:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79600, rc 0) 00000100:00100000:0.0:1788658722.482979:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103838720:12345-0@lo:101:mount.lustre.0 Request processed in 204us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.482987:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788658722.483106:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838720:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788658722.483123:0:20355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658722.483134:0:20355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658722.483659:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788658722.484277:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658722.484819:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788658722.484868:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788658722.484921:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788658722.484960:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788658722.484997:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788658722.485063:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788658722.485102:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788658722.485137:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788658722.485223:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788658722.485231:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788658722.485325:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838848:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658722.485394:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658722.485439:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.485467:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838848 00000100:00100000:3.0:1788658722.485473:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838848 00000100:00100000:3.0:1788658722.485715:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788658722.485726:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103838848:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658722.485981:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103838848:12345-0@lo:501:mount.lustre.0 Request processed in 256us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.485995:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788658722.486092:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788658722.486144:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788658722.486198:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.489362:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103838976 00000100:00100000:0.0:1788658722.489375:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103838976 00000100:00100000:0.0:1788658722.489428:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788658722.489438:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103838976:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658722.489680:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103838976:12345-0@lo:503:mount.lustre.0 Request processed in 227us (3465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.489689:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788658722.490126:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbacacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788658722.490154:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103838976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788658722.490761:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788658722.490841:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658722.490906:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.490947:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbacacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.491097:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839104 00000100:00100000:0.0:1788658722.491104:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839104 00000100:00100000:0.0:1788658722.491156:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788658722.491165:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103839104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658722.491351:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff0ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103839104:12345-0@lo:502:mount.lustre.0 Request processed in 187us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.491367:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788658722.491474:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788658722.491857:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788658722.491907:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788658722.491956:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788658722.491994:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788658722.492031:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788658722.492078:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788658722.492115:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788658722.492147:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788658722.492177:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788658722.492242:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658722.492338:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbacacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.494641:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839232 00000100:00100000:3.0:1788658722.494657:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839232 00000100:00100000:0.0:1788658722.495934:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658722.495951:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e2fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103839232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658722.496229:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e2fb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103839232:12345-0@lo:502:mount.lustre.0 Request processed in 282us (3985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.496237:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788658722.496328:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839232:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658722.496486:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788658722.496514:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788658722.498286:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658722.498297:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.498300:0:20360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788658722.498307:0:20360:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56deaab000 00000020:00000080:1.0:1788658722.498310:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658722.498318:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658722.498321:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.498322:0:20360:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788658722.498325:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658722.498327:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.498328:0:20360:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788658722.498332:0:20360:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9e56deaab000 00000020:00000080:1.0:1788658722.498335:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658722.498432:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658722.498436:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.498438:0:20360:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788658722.498441:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788658722.498444:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.498445:0:20360:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788658722.498448:0:20360:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9e56deaab000 00000020:00000080:1.0:1788658722.498451:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788658722.501758:0:20360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788658722.501772:0:20360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788658722.501774:0:20360:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788658722.501780:0:20360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788658722.510050:0:20355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788658722.510091:0:20355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788658722.510119:0:20355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510134:0:20355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658722.510188:0:20355:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788658722.510191:0:20355:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9e56deaab000 10000000:01000000:0.0:1788658722.510194:0:20355:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9e56deaab000 10000000:01000000:0.0:1788658722.510211:0:20355:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788658722.510217:0:20355:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9e56deaab000 from 1 10000000:01000000:0.0:1788658722.510219:0:20355:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788658722.510258:0:20355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510267:0:20355:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510284:0:20355:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658722.510309:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788658722.510378:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.510419:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839360 00000100:00100000:0.0:1788658722.510426:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839360 00000100:00100000:0.0:1788658722.510477:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658722.510487:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e2fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103839360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658722.510501:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658722.510583:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78800/0xf657f176650ec445 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec43e expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510607:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78800/0xf657f176650ec445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec43e expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510618:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78800/0xf657f176650ec445 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec43e expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510628:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78800, rc 0) 00000100:00100000:0.0:1788658722.510697:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e2fb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839360:12345-0@lo:101:mount.lustre.0 Request processed in 178us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.510705:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788658722.510751:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c88179c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.510774:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788658722.510789:0:20355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec445 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.510806:0:20355:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec445 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788658722.511411:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:0.0:1788658722.513246:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788658722.516760:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788658722.516868:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788658722.516904:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788658722.516952:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788658722.516987:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788658722.517033:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788658722.517070:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788658722.517103:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788658722.517149:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788658722.517186:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788658722.518769:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788658722.518876:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788658722.518914:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788658722.518950:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788658722.519000:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788658722.519034:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788658722.519067:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788658722.519115:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788658722.519154:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788658722.519189:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788658722.519257:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788658722.519295:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788658722.519324:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788658722.519368:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788658722.519402:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788658722.519434:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788658722.519497:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788658722.521377:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788658722.521424:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788658722.521488:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788658722.523295:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788658722.523371:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788658722.523407:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788658722.523477:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788658722.523514:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788658722.524755:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788658722.524796:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788658722.524833:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788658722.524880:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788658722.524916:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788658722.525007:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788658722.525014:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788658722.525136:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658722.525203:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.525276:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c88179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658722.525368:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839488 00000100:00100000:3.0:1788658722.525375:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839488 00000100:00100000:3.0:1788658722.525428:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788658722.525439:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839488:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788658722.525748:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839488:12345-0@lo:501:mount.lustre.0 Request processed in 311us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.525757:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788658722.527730:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788658722.527791:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788658722.527860:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.527909:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c88179c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.528711:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839616 00000100:00100000:1.0:1788658722.528721:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839616 00000100:00100000:1.0:1788658722.528775:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788658722.528785:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788658722.529000:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839616:12345-0@lo:503:mount.lustre.0 Request processed in 216us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658722.529018:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788658722.529316:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788658722.531865:0:20355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788658722.531969:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658722.532043:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.532090:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c2891840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.532206:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839744 00000100:00100000:1.0:1788658722.532223:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839744 00000100:00100000:1.0:1788658722.532270:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788658722.532279:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658722.532508:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839744:12345-0@lo:502:mount.lustre.0 Request processed in 229us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658722.532516:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788658722.533715:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788658722.533984:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788658722.534040:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788658722.534078:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788658722.534127:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788658722.534164:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788658722.534227:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788658722.534268:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788658722.534305:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788658722.534356:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788658722.534390:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788658722.534419:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788658722.534465:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788658722.534502:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788658722.543837:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788658722.543969:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788658722.544016:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788658722.544049:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788658722.544093:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788658722.544130:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788658722.544192:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788658722.544259:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788658722.544294:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788658722.544326:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788658722.544391:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788658722.544431:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788658722.544462:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788658722.544504:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788658722.545197:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788658722.545261:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788658722.545318:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788658722.545358:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788658722.545396:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788658722.545431:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788658722.545477:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788658722.545522:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788658722.545747:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788658722.545784:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788658722.545817:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788658722.545864:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788658722.545902:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788658722.545957:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788658722.546032:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658722.546074:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d6f586c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.546155:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103839872 00000100:00100000:0.0:1788658722.546164:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103839872 00000100:00100000:0.0:1788658722.546231:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788658722.546241:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788658722.546459:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103839872:12345-0@lo:502:mount.lustre.0 Request processed in 219us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.546468:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788658722.546706:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103839872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788658722.546774:0:20355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788658722.546783:0:20355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788658722.547851:0:20365:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788658722.547867:0:20365:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9e56c64499c0) 00000020:00000080:1.0:1788658722.547892:0:20365:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788658722.547960:0:20365:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9e56deaab000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788658722.547964:0:20365:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9e56deaab000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788658722.547966:0:20365:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9e56deaab000 3 00010000:00080000:1.0:1788658722.548008:0:20365:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9e55c37ef000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1788658722.553398:0:20365:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788658722.555263:0:20365:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788658722.555309:0:20365:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788658722.555323:0:20365:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf657f176650ec453 00000100:00080000:1.0:1788658722.555335:0:20365:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788658722.555341:0:20365:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9e55c37ef000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658722.555382:0:20365:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57007e1880 x1875544103840000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658722.555455:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103840000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788658722.555530:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788658722.555660:0:20365:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788658722.556256:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788658722.556267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788658722.556270:0:36:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788658722.556275:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:1.0:1788658722.556280:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788658722.556285:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183b000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1788658722.556301:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e57007e0000 x1875544103840256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788658722.556351:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103840128:0@lo:400:kworker.0 00000100:00100000:1.0:1788658722.556392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658722.556432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788658722.556438:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103840384:0@lo:400:kworker.0 00000100:00100000:1.0:1788658722.556470:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103840512:0@lo:400:kworker.0 00000100:00100000:1.0:1788658722.556520:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840128 00000100:00100000:1.0:1788658722.556528:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840128 00000100:00100000:2.0:1788658722.557564:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103840256:0@lo:8:kworker.0 00000100:00100000:2.0:1788658722.557604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658722.557880:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840256 00000100:00100000:1.0:1788658722.557886:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840256 00000100:00100000:1.0:1788658722.557907:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658722.557917:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103840128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658722.557967:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875544103840128:12345-0@lo:400:kworker.0 Request processed in 53us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658722.557975:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788658722.557990:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788658722.557994:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103840256:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788658722.558041:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875544103840256:12345-0@lo:8:kworker.0 Request processed in 45us (437us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788658722.558047:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788658722.558189:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658722.558260:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840000 00000100:00100000:0.0:1788658722.558265:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840000 00000100:00100000:1.0:1788658722.558324:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658722.558332:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788658722.558336:0:3303:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788658722.558340:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103840256:0@lo:8:kworker.0 00000100:00100000:1.0:1788658722.558366:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658722.558580:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.558631:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840512 00000100:00100000:0.0:1788658722.558636:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840512 00000100:00100000:0.0:1788658722.558926:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658722.558937:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103840512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658722.558986:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875544103840512:12345-0@lo:400:kworker.0 Request processed in 53us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.559003:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788658722.559020:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658722.559024:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1875544103840000:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788658722.559041:0:18952:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:0.0:1788658722.559077:0:18952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf657f176650ec45a 00000004:00100000:0.0:1788658722.559092:0:18952:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788658722.559136:0:18952:0:(import.c:65:import_set_state_nolock()) ffff9e56ff882800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658722.559173:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875544103840000:12345-0@lo:38:llog_process_th.0 Request processed in 148us (3643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.559180:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788658722.559195:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788658722.562085:0:20365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788658722.562158:0:20355:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788658722.562189:0:20355:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788658722.562207:0:20355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec445 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.562219:0:20355:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56fac78600/0xf657f176650ec43e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec445 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788658722.562282:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788658722.562285:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658722.562286:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658722.562287:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658722.562288:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658722.562289:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658722.562291:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658722.562292:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658722.562294:0:20355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658722.562298:0:20355:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788658722.562305:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788658722.562307:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658722.562308:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658722.562308:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658722.562309:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658722.562311:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658722.562312:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658722.562313:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658722.562313:0:20355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788658722.562340:0:20355:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788658722.562360:0:20355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103840640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788658722.562432:0:20355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.562467:0:20355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c2891000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658722.562812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103840128:0@lo:400:kworker.0 00010000:00080000:1.0:1788658722.562856:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57007e1880 x1875544103840000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788658732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658722.562866:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788658722.562874:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788658722.562882:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788658722.562887:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788658722.562890:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e55c37ef000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788658722.562896:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875544103840000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788658722.562917:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840640 00000100:00100000:1.0:1788658722.562923:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840640 00000100:00100000:1.0:1788658722.562960:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788658722.562969:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:20355:x1875544103840640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788658722.563008:0:18945:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788658722.563025:0:18945:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788658722.563645:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840384 00000100:00100000:0.0:1788658722.563652:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840384 00000100:00100000:0.0:1788658722.563710:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788658722.563718:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103840384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658722.563783:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875544103840384:12345-0@lo:400:kworker.0 Request processed in 66us (5203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.563791:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788658722.564042:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57007e3480 x1875544103840512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658722.564055:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875544103840512:0@lo:400:kworker.0 00010000:00080000:1.0:1788658722.564087:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9e57007e3100 x1875544103840384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788658722.565693:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875544103840384:0@lo:400:kworker.0 20000000:01000000:2.0:1788658722.592444:0:18945:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788658722.592533:0:18945:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788658722.595572:0:18967:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788658722.595585:0:18967:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788658722.595613:0:18967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.595636:0:18967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec318 expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.595645:0:18967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.595717:0:18967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658722.595733:0:18967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 19 pid: 18943 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658722.595748:0:18967:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103840768:0@lo:104: 00000100:00100000:1.0:1788658722.595822:0:18967:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658722.595871:0:18967:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788658722.596069:0:18934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840768 00000100:00100000:0.0:1788658722.596076:0:18934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840768 00000100:00100000:0.0:1788658722.596141:0:18934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658722.596151:0:18934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103840768:12345-0@lo:104: 00010000:00010000:0.0:1788658722.596166:0:18934:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596248:0:18934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788658722.596267:0:18934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:18967:x1875544103840768:12345-0@lo:104: Request processed in 117us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.596275:0:18934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788658722.596312:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658722.596318:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596324:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efc00 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:0.0:1788658722.596328:0:18940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596338:0:18940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788658722.596345:0:18940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788658722.596351:0:18940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788658722.596385:0:18940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596392:0:18940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788658722.596414:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596421:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007efc00/0xf657f176650ec318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec31f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596437:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658722.596439:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658722.596441:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658722.596462:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103840896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658722.596499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658722.596576:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103840896 00000100:00100000:0.0:1788658722.596580:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103840896 00010000:00010000:0.0:1788658722.596600:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 20 pid: 18943 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658722.596625:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658722.596632:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+20:3305:x1875544103840896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658722.596643:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658722.596649:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 20 pid: 18943 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596659:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 20 pid: 18943 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596727:0:18938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596735:0:18938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788658722.596753:0:18938:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001167633s 00010000:00010000:0.0:1788658722.596759:0:18938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596766:0:18938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596774:0:18938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596781:0:18938:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596798:0:18938:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658722.596803:0:18938:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596811:0:18938:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596819:0:18938:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.596831:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658722.596866:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+20:3305:x1875544103840896:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658722.596874:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658722.596947:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103840896:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658722.596978:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e57007ee000/0xf657f176650ec31f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec318 expref: 19 pid: 18943 timeout: 713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658722.596988:0:18967:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18967:1875544103840768:0@lo:104: 00010000:00010000:0.0:1788658722.597001:0:18967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.597011:0:18967:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.597018:0:18967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658722.597037:0:18967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed35000/0xf657f176650ec461 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658722.602470:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:20355:x1875544103840640:12345-0@lo:253:mount.lustre.0 Request processed in 39490us (40027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658722.602488:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788658722.602600:0:20355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4b7533a2-f0ee-43c1-8561-a2cc551aa877:20355:1875544103840640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788658722.602618:0:20355:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788658722.602621:0:20355:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788658722.602623:0:20355:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788658722.602624:0:20355:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788658722.602625:0:20355:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788658722.602626:0:20355:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788658722.602628:0:20355:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788658722.602629:0:20355:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788658722.602631:0:20355:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788658722.602632:0:20355:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788658722.602646:0:20355:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788658722.603115:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658722.603463:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788658722.603731:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658722.603883:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788658722.604030:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788658722.604343:0:20355:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788658722.605394:0:20355:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788658722.659823:0:20355:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788658722.659836:0:20355:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788658722.659908:0:20355:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788658722.659980:0:20355:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788658722.659996:0:20355:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788658722.660036:0:20355:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788658723.036949:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658724.060959:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788658724.342784:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788658724.342855:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:1.0:1788658724.446375:0:18948:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788658724.446386:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9e56eee1b000 from 11 10000000:01000000:1.0:1788658724.446395:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788658724.446452:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658724.446464:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658724.446492:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658724.446519:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103841024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788658724.446594:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658724.446646:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788658724.446800:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841024 00000100:00100000:0.0:1788658724.446808:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841024 00000100:00100000:0.0:1788658724.446851:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788658724.446859:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103841024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658724.446871:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658724.446884:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78a00/0xf657f176650ec46f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec468 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658724.446906:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78a00/0xf657f176650ec46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec468 expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658724.446916:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78a00/0xf657f176650ec46f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec468 expref: 19 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658724.446924:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78a00, rc 0) 00000100:00100000:0.0:1788658724.446981:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103841024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658724.446987:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788658724.450476:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103841024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658724.450510:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec46f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658724.450528:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec46f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658724.450619:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103841152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788658724.450704:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658724.450742:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca000 going to sleep for 11 seconds 00000100:00100000:1.0:1788658724.451457:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841152 00000100:00100000:1.0:1788658724.451468:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841152 00000100:00100000:1.0:1788658724.451546:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658724.451557:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103841152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788658724.451579:0:18945:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788658724.451599:0:18945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788658724.451602:0:18945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788658724.451736:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103841152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658724.451745:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788658724.451793:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefda300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103841152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788658724.451862:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788658724.451872:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec46f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658724.451882:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56eed35e00/0xf657f176650ec468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec46f expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658725.090843:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658726.112530:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658726.302377:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103841280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658726.302461:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658726.302645:0:19640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841280 00000100:00100000:1.0:1788658726.302653:0:19640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841280 00000100:00100000:1.0:1788658726.302763:0:19640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658726.302774:0:19640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103841280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658726.302808:0:19640:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658726.302858:0:19640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103841280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658726.302865:0:19640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658726.302906:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788658726.302929:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103841280:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788658726.302991:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788658727.142016:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658727.517270:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788658727.839334:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788658727.839341:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788658727.839345:0:8:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788658727.839359:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9e56d183b000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1788658727.839383:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9e56fefd8e00 x1875544103841664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788658727.839436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103841408:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.839504:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839558:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103842048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.839585:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839700:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658727.839707:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103841920:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.839748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839778:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103841536:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.839803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839823:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658727.839828:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103841792:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.839847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839875:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103841664:0@lo:8:kworker.0 00000100:00100000:2.0:1788658727.839901:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.839931:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841408 00000100:00100000:2.0:1788658727.839938:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841408 00000100:00100000:2.0:1788658727.839982:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788658727.839991:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3307:x1875544103841408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.840036:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3307:x1875544103841408:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658727.840144:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841536 00000100:00100000:1.0:1788658727.840149:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841536 00000100:00100000:1.0:1788658727.840176:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841664 00000100:00100000:1.0:1788658727.840180:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841664 00000100:00100000:1.0:1788658727.840195:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658727.840202:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103841536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658727.840241:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103841536:12345-0@lo:400:kworker.0 Request processed in 40us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658727.840249:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658727.840265:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788658727.840269:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1875544103841664:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788658727.840305:0:20273:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:1.0:1788658727.840336:0:20273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf657f176650ec476 00002000:00100000:1.0:1788658727.840350:0:20273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9e55c37ea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788658727.840354:0:20273:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788658727.840357:0:20273:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788658727.840779:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788658727.840813:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842048 00000100:00100000:2.0:1788658727.840817:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842048 00000100:00100000:2.0:1788658727.840851:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841920 00000100:00100000:2.0:1788658727.840854:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841920 00000100:00100000:2.0:1788658727.840867:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103841792 00000100:00100000:2.0:1788658727.840869:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103841792 00000100:00100000:2.0:1788658727.840881:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658727.840888:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103842048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.840924:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103842048:12345-0@lo:400:kworker.0 Request processed in 36us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658727.840930:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788658727.840942:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658727.840958:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103841920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.840989:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103841920:12345-0@lo:400:kworker.0 Request processed in 32us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658727.840994:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788658727.841006:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788658727.841012:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103841792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.841035:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103841792:12345-0@lo:400:kworker.0 Request processed in 24us (1187us total) trans 0 rc 0/0 00002000:00080000:1.0:1788658727.841231:0:20273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788658727.841257:0:20273:0:(import.c:65:import_set_state_nolock()) ffff9e55c37ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658727.841318:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875544103841664:12345-0@lo:8:kworker.0 Request processed in 1047us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658727.841326:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788658727.841873:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658727.842138:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788658727.842560:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fefd8e00 x1875544103841664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788658752 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788658727.842582:0:3303:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788658727.842597:0:3303:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788658727.842604:0:3303:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788658727.842606:0:3303:0:(import.c:65:import_set_state_nolock()) ffff9e56d183b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788658727.842622:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788658727.842627:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875544103841664:0@lo:8:kworker.0 00000004:00080000:2.0:1788658727.842705:0:18976:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788658727.842724:0:18976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18976:1875544103842304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788658727.842773:0:18976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.842798:0:18976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca900 going to sleep for 11 seconds 00000004:00080000:2.0:1788658727.842812:0:18975:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788658727.844884:0:18975:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 618984215741ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788658727.844916:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788658727.844936:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103842176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658727.845012:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.845197:0:19640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842176 00000100:00100000:2.0:1788658727.845205:0:19640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842176 00000100:00100000:2.0:1788658727.845258:0:19640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788658727.845268:0:19640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103842176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788658727.845310:0:19640:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788658727.845358:0:19640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875544103842176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658727.845366:0:19640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788658727.845388:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788658727.845439:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fefd9c00 x1875544103841792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658727.845454:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103841792:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.845467:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103841536:0@lo:400:kworker.0 00010000:00080000:2.0:1788658727.845499:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56e5b0a300 x1875544103842176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788658743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658727.845515:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103842176:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788658727.845543:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fefd9180 x1875544103841920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658727.845553:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103841920:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.845565:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103841408:0@lo:400:kworker.0 00010000:00080000:2.0:1788658727.845575:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9e56fefdb100 x1875544103842048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788658743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788658727.845819:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103842048:0@lo:400:kworker.0 00000100:00100000:2.0:1788658727.846167:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842304 00000100:00100000:2.0:1788658727.846173:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842304 00000100:00100000:2.0:1788658727.846208:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658727.846216:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18976:x1875544103842304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788658727.856204:0:20273:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788658727.856221:0:20273:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788658727.856227:0:20273:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:2.0:1788658727.869785:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.869798:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.869818:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.869823:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.869831:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.869848:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.869860:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.869869:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.869898:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658727.870599:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.870608:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.870616:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.870620:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.870631:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.870688:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.870696:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec47d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.870718:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.870720:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.870722:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.871512:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.871522:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.871534:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.871538:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.871543:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.871554:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.871562:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.871570:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.871657:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.872238:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.872245:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872254:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.872265:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.872270:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872291:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872300:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872308:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872330:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658727.872344:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658727.872350:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872357:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.872362:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872371:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872388:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872407:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec484 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872427:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.872431:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872438:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eee00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.872441:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872447:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872457:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872464:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec48b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.872475:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.872477:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.872478:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.872721:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.873534:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.873542:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.873561:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.873564:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.873569:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.873580:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.877156:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.877168:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.877189:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.879431:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.879444:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879463:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.879467:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.879474:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879489:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879513:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879521:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879544:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658727.879565:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658727.879571:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.879579:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.879583:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.880951:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.880962:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.880975:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efa00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.880979:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.880990:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.881010:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.881018:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065d8122d/0xf657f176650ec499 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.881063:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.881065:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.881067:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.881133:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.881146:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.881153:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d99af001/0xf657f176650ec492 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.881168:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.881176:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.881177:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.888660:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.888689:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888709:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.888714:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.888721:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888736:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888748:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888755:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888778:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.888792:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.888798:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888805:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.888809:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888831:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888847:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888855:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063d677b7/0xf657f176650ec4a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.888873:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.888875:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.888876:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.889522:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.889529:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.889538:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.889542:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.889547:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.889556:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.889565:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.889579:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.889598:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.890025:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.890032:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890304:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.890312:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890321:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.890325:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890334:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890347:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890354:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005235094d/0xf657f176650ec4a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.890371:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.890373:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.890375:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.891210:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.891216:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.891222:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891237:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891247:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891254:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891274:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.891296:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.891301:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891316:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eea00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.891321:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891328:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891340:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891347:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1179bc2/0xf657f176650ec4ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.891365:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.891367:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.891369:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.893138:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.893149:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893163:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.893167:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.893173:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893186:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893202:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893210:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893230:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.893245:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.893251:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893258:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eec00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.893262:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893271:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893297:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893305:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007b3a740/0xf657f176650ec4b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.893325:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.893333:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.893335:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.897599:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.897618:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.897637:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.897642:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.897649:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.897687:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.897699:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.897708:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.897732:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658727.898233:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658727.898241:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.898249:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658727.898254:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.898263:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.898293:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.898301:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfcf795/0xf657f176650ec4bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.898327:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658727.898329:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658727.898331:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.898901:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.898909:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.898921:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.898925:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.898931:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.898948:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.898958:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.898966:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.898986:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788658727.899172:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788658727.899179:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.899186:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:1.0:1788658727.899196:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.899206:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.899219:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.899227:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bef19e7/0xf657f176650ec4c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658727.899243:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658727.899245:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788658727.899246:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.902730:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.902749:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902770:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.902774:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.902781:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902798:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902809:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902833:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902855:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.902870:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.902876:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902883:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007efc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.902887:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902896:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902913:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902921:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e871fb16/0xf657f176650ec4ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.902945:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.902947:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.902949:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.903453:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.903482:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903493:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.903498:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.903502:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903513:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903521:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903528:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903544:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.903980:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.903987:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.903996:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.903999:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.904003:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904013:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904029:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904037:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904056:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788658727.904073:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788658727.904079:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904086:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ee000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.904090:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904100:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904112:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904120:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017427a42/0xf657f176650ec4d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904138:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.904147:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904153:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.904156:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904163:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904173:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904180:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d742c46e/0xf657f176650ec4d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.904194:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.904196:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.904197:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.908161:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.908964:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.908974:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.908991:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.908995:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.909002:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909029:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909123:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909133:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909193:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.909727:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.909734:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909744:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.909747:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.909752:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909763:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909772:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.909792:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915743:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788658727.915764:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915782:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007eee00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658727.915787:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915820:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915847:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915855:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f0b3677/0xf657f176650ec4df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915886:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658727.915890:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915897:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658727.915900:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915908:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915918:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.915926:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.915927:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.915935:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.917523:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658727.917540:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaeb0fae/0xf657f176650ec4e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.917596:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.918822:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.918832:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.918849:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.918854:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.918861:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.918875:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.918885:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.918893:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.918921:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658727.919489:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658727.919497:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.919506:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658727.919510:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.919519:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.919536:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.919543:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069cbaaf1/0xf657f176650ec4ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.919560:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.919561:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.919563:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.920529:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.920537:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.920549:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.920553:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.920558:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.920568:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.920577:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922147:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922184:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.922200:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.922206:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922213:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cce00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.922224:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922234:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922253:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922260:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec4f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.922291:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.922293:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.922295:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.928164:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.928182:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.928201:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.928206:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.928212:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.928228:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.928240:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.928263:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.928300:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658727.929714:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.929726:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.929751:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.929756:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.929767:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.929786:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.929794:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000da4c02e/0xf657f176650ec4fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.929814:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.929816:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.929818:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.933237:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.933251:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.933271:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.933287:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.933294:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.933308:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.933319:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.933328:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.933345:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658727.933736:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658727.933745:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.933753:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658727.933758:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.933780:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.933798:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.933806:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ace5ed/0xf657f176650ec502 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.933824:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.933825:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.933827:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.935013:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.935022:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788658727.936444:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788658727.936653:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.936661:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.936691:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.936711:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.936722:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.936730:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.936787:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788658727.937708:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.937717:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.937729:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cce00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.937734:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.937758:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.937777:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.937786:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e1a7874/0xf657f176650ec509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.937810:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.937812:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.937813:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.938560:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.938568:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.938580:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.939758:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.939774:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.939794:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.939820:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.939828:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.939901:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.940496:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.940503:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.940513:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.940517:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.940521:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.940530:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.940538:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.940545:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945306:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658727.945323:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945339:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cca00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.945344:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945357:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945379:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945403:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d5f2798/0xf657f176650ec510 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945430:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.945434:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945441:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cdc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.945444:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945452:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945462:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.945469:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.945470:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.945472:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.945850:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658727.945858:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d4c1504/0xf657f176650ec517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658727.946516:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.946524:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.946538:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.946542:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.946549:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.946562:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.946571:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.946579:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947008:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.947027:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.947033:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947058:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.947062:0:18939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947071:0:18939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947086:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947094:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000077076de/0xf657f176650ec51e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947113:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.947115:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.947117:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.947778:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.947787:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947800:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.947803:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.947808:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947819:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947835:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947843:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947860:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788658727.947871:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788658727.947877:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947884:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658727.947888:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947895:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947908:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947916:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030342003/0xf657f176650ec525 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.947929:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.947937:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.947938:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.948147:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.948519:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.948526:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.948536:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.948540:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.948544:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.948554:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.948564:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.948571:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.948991:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.949482:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.949489:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.949502:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.949506:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.949511:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.949529:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.949539:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.949546:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.949570:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788658727.950157:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658727.950165:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950174:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.950185:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950195:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950210:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950217:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034a176a1/0xf657f176650ec52c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950236:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.950239:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950246:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.950249:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950256:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950266:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950273:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000730ec1d0/0xf657f176650ec533 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.950304:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.950306:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.950308:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.950372:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.950545:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.950552:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.950561:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.950565:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.950569:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.950579:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.950760:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.950780:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.950801:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788658727.951138:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788658727.951145:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.951153:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cda00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658727.951157:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.951166:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.951179:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.951193:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008988c060/0xf657f176650ec53a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658727.951209:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.951211:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.951212:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788658727.951454:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.951460:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.951469:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.951473:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.951477:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.951487:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.951495:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.951503:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.951567:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.952017:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.952023:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.952051:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.952056:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.952061:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.952072:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.952081:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.952089:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952483:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658727.952491:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952500:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.952504:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952513:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952527:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952534:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006563bcd2/0xf657f176650ec541 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952552:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.952556:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952562:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc000 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.952573:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952592:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952604:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.952613:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.952614:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.952616:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788658727.952923:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788658727.952930:0:20273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d254dc64/0xf657f176650ec548 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658727.953474:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.953480:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.953491:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.953496:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.953501:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.953523:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.953534:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.953541:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.953556:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788658727.954253:0:20273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788658727.954259:0:20273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.954269:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=619s v=(0 0) 00010000:00010000:2.0:1788658727.954272:0:20273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658727.954287:0:20273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.954297:0:20273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.954306:0:20273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.954324:0:20273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658727.957342:0:20273:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788658727.958177:0:20273:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788658727.958291:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18976:x1875544103842304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 112062us (115504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658727.958303:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788658727.958373:0:18976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18976:1875544103842304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788658727.958390:0:18976:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788658727.958438:0:18976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18976:1875544103842432:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788658727.958470:0:18976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658727.958517:0:18976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56fbaca900 going to sleep for 11 seconds 00000100:00100000:2.0:1788658727.958537:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842432 00000100:00100000:2.0:1788658727.958543:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842432 00000100:00100000:2.0:1788658727.958584:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788658727.958592:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18976:x1875544103842432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788658727.958633:0:19638:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00010000:00010000:3.0:1788658727.959713:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658727.959726:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959739:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3ccc00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.959744:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959757:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959778:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959786:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006aa4b86/0xf657f176650ec54f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959823:0:20274:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658727.959827:0:20274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959833:0:20274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cde00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658727.959837:0:20274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959845:0:20274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959855:0:20274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959862:0:20274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f01ba1/0xf657f176650ec556 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658727.959875:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.959877:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658727.959879:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.959956:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658727.959964:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658727.969153:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:18976:x1875544103842432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10552us (10673us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788658727.969167:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658727.969374:0:18976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b09880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18976:1875544103842432:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788658727.969390:0:18976:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:2.0:1788658728.162362:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788658728.580024:0:20707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788658729.180875:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658730.209895:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788658730.884793:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658730.885024:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584320 00000100:00100000:1.0:1788658730.885042:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584320 00000100:00100000:1.0:1788658730.885108:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:1.0:1788658730.885118:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875544076584320:12345-192.168.202.3@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788658730.885157:0:18945:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3d29274b-714d-4f7c-845d-b6bb1e24047c@192.168.202.3@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:1.0:1788658730.885195:0:18945:0:(genops.c:1385:class_connect()) connect: client 3d29274b-714d-4f7c-845d-b6bb1e24047c, cookie 0xf657f176650ec55d 00000100:00080000:1.0:1788658730.885403:0:18945:0:(import.c:65:import_set_state_nolock()) ffff9e55c37e9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658730.885513:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+5:2350:x1875544076584320:12345-192.168.202.3@tcp:250:mount.lustre.0 Request processed in 385us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658730.885523:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:1.0:1788658730.896174:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.896567:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584448 00000100:00100000:2.0:1788658730.896580:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584448 00000100:00100000:2.0:1788658730.896719:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:2.0:1788658730.896731:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+5:16753:x1875544076584448:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658730.896755:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658730.896779:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ec564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b2b1 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.896816:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ec564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2b1 expref: 6 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.896827:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd200/0xf657f176650ec564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2b1 expref: 6 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.896837:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd200, rc 0) 00000100:00100000:2.0:1788658730.896916:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+6:16753:x1875544076584448:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 187us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.896924:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:3.0:1788658730.903938:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.904207:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584576 00000100:00100000:2.0:1788658730.904226:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584576 00000100:00100000:2.0:1788658730.904338:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:2.0:1788658730.904351:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+6:16753:x1875544076584576:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658730.906259:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+6:16753:x1875544076584576:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 1898us (2320us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788658730.906284:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:3.0:1788658730.917325:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658730.919122:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584704 00000100:00100000:1.0:1788658730.919137:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584704 00000100:00100000:0.0:1788658730.923150:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:0.0:1788658730.923164:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+6:16753:x1875544076584704:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658730.923183:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658730.923205:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79a00/0xf657f176650ec56b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b2b8 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658730.923237:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79a00/0xf657f176650ec56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2b8 expref: 7 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658730.923248:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79a00/0xf657f176650ec56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2b8 expref: 7 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658730.923257:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79a00, rc 0) 00000100:00100000:0.0:1788658730.923344:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+7:16753:x1875544076584704:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 182us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658730.923352:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1788658730.932763:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.932896:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584832 00000100:00100000:2.0:1788658730.932916:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584832 00000100:00100000:2.0:1788658730.933001:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1788658730.933015:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+7:16753:x1875544076584832:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658730.934020:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16753:x1875544076584832:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 1003us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.934030:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:3.0:1788658730.936131:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.936237:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076584960 00000100:00100000:2.0:1788658730.936254:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076584960 00000100:00100000:2.0:1788658730.938749:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1788658730.938768:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16753:x1875544076584960:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658730.939800:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16753:x1875544076584960:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 1032us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.939815:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:3.0:1788658730.943852:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.944025:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585088 00000100:00100000:2.0:1788658730.944036:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585088 00000100:00100000:2.0:1788658730.944152:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:2.0:1788658730.944163:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16771:x1875544076585088:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658730.945854:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16771:x1875544076585088:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 1682us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.945867:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:1.0:1788658730.969782:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.969942:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585216 00000100:00100000:2.0:1788658730.969953:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585216 00000100:00100000:2.0:1788658730.970014:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:2.0:1788658730.970025:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16771:x1875544076585216:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658730.970336:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16771:x1875544076585216:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 310us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.970345:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:3.0:1788658730.983378:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658730.983936:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585344 00000100:00100000:2.0:1788658730.983949:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585344 00000100:00100000:2.0:1788658730.984019:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:2.0:1788658730.984030:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+8:16753:x1875544076585344:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658730.984048:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658730.984066:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd600/0xf657f176650ec572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b2e2 expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.984096:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd600/0xf657f176650ec572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e2 expref: 9 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.984108:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd600/0xf657f176650ec572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e2 expref: 9 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658730.984118:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd600, rc 0) 00000100:00100000:2.0:1788658730.984231:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+9:16753:x1875544076585344:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 201us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658730.984238:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:3.0:1788658730.996064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658730.996181:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585472 00000100:00100000:0.0:1788658730.996192:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585472 00000100:00100000:0.0:1788658730.996254:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:0.0:1788658730.996273:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+9:16753:x1875544076585472:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788658730.996302:0:18945:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788658730.996330:0:18945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788658730.996334:0:18945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788658730.996337:0:18945:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788658730.996340:0:18945:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788658730.997903:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+9:16753:x1875544076585472:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 1628us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658730.997916:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1788658731.003717:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.003864:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585600 00000100:00100000:0.0:1788658731.003874:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585600 00000100:00100000:0.0:1788658731.003934:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:0.0:1788658731.003944:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+9:16753:x1875544076585600:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658731.003961:0:18943:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658731.003980:0:18943:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b2e9 expref: -99 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.004009:0:18943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 10 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.004021:0:18943:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 10 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.004029:0:18943:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:0.0:1788658731.004090:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16753:x1875544076585600:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 147us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.004098:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:2.0:1788658731.008821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658731.008964:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585728 00000100:00100000:3.0:1788658731.008974:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585728 00000100:00100000:3.0:1788658731.009032:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:3.0:1788658731.009043:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16753:x1875544076585728:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658731.009387:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16753:x1875544076585728:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 344us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658731.009396:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:3.0:1788658731.015909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658731.018788:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585856 00000100:00100000:2.0:1788658731.018806:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585856 00000100:00100000:2.0:1788658731.018940:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:2.0:1788658731.018952:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16753:x1875544076585856:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658731.019369:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16753:x1875544076585856:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 416us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658731.019378:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:2.0:1788658731.025516:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.027073:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076585984 00000100:00100000:0.0:1788658731.027105:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076585984 00000100:00100000:0.0:1788658731.027168:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:0.0:1788658731.027178:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fb14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16776:x1875544076585984:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788658731.027493:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fb14d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16776:x1875544076585984:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 314us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.027501:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:0.0:1788658731.036821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658731.040291:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586112 00000100:00100000:2.0:1788658731.040309:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586112 00000100:00100000:2.0:1788658731.040422:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:2.0:1788658731.040430:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56d6cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16776:x1875544076586112:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658731.040688:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56d6cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16776:x1875544076586112:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 258us (3880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658731.040694:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:1.0:1788658731.045939:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658731.046027:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586240 00000100:00100000:2.0:1788658731.046037:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586240 00000100:00100000:2.0:1788658731.046092:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658731.046101:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875544076586240:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658731.046133:0:18951:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 18e15d94-c398-4038-931d-96e7c6453e92@192.168.202.3@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1788658731.046184:0:18951:0:(genops.c:1385:class_connect()) connect: client 18e15d94-c398-4038-931d-96e7c6453e92, cookie 0xf657f176650ec580 00000004:00100000:2.0:1788658731.046213:0:18951:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788658731.046220:0:18951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788658731.078800:0:18951:0:(import.c:65:import_set_state_nolock()) ffff9e55c1c8c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788658731.078877:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+6:2350:x1875544076586240:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 32774us (32950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658731.078889:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1788658731.081522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658731.081568:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658731.081843:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586496 00000100:00100000:2.0:1788658731.081854:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586496 00000100:00100000:2.0:1788658731.081919:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586368 00000100:00100000:2.0:1788658731.081923:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586368 00000100:00100000:2.0:1788658731.081949:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1788658731.081959:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:16753:x1875544076586496:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788658731.082017:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788658731.082101:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:16753:x1875544076586496:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 143us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658731.082109:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1788658731.082126:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:2.0:1788658731.082149:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:0:x1875544076586368:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788658731.082160:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788658731.082181:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:0:x1875544076586368:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 33us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658731.082187:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00080000:3.0:1788658731.083467:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788658731.085183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.085348:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586624 00000100:00100000:0.0:1788658731.085357:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586624 00000100:00100000:0.0:1788658731.085419:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658731.085430:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:16753:x1875544076586624:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788658731.085554:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:16753:x1875544076586624:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 125us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.085562:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1788658731.095327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658731.095359:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.095470:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586752 00000100:00100000:0.0:1788658731.095480:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586752 00000100:00100000:0.0:1788658731.095531:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076586880 00000100:00100000:0.0:1788658731.095535:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076586880 00000100:00100000:0.0:1788658731.095558:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658731.095567:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875544076586752:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658731.095599:0:19639:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 18e15d94-c398-4038-931d-96e7c6453e92@192.168.202.3@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:0.0:1788658731.095633:0:19639:0:(genops.c:1385:class_connect()) connect: client 18e15d94-c398-4038-931d-96e7c6453e92, cookie 0xf657f176650ec587 00002000:00100000:0.0:1788658731.095644:0:19639:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 18e15d94-c398-4038-931d-96e7c6453e92/ffff9e55c1ad9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658731.095686:0:19639:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788658731.096109:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1788658731.096117:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875544076586880:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788658731.096136:0:20273:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 18e15d94-c398-4038-931d-96e7c6453e92@192.168.202.3@tcp t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:1.0:1788658731.096156:0:20273:0:(genops.c:1385:class_connect()) connect: client 18e15d94-c398-4038-931d-96e7c6453e92, cookie 0xf657f176650ec58e 00002000:00100000:1.0:1788658731.096162:0:20273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 18e15d94-c398-4038-931d-96e7c6453e92/ffff9e55c37ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788658731.096177:0:20273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788658731.096322:0:20273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788658731.096351:0:20273:0:(import.c:65:import_set_state_nolock()) ffff9e55c37ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658731.096412:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e15d94-c398-4038-931d-96e7c6453e92+6:2350:x1875544076586880:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 293us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658731.096420:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00002000:00080000:0.0:1788658731.096834:0:19639:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658731.096866:0:19639:0:(import.c:65:import_set_state_nolock()) ffff9e55c1add800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658731.096905:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:2350:x1875544076586752:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 1338us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.096913:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1788658731.097385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.097520:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587008 00000100:00100000:0.0:1788658731.097526:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587008 00000100:00100000:0.0:1788658731.097567:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658731.097576:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+6:16753:x1875544076587008:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788658731.099152:0:18954:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1516us 00000004:00200000:0.0:1788658731.109474:0:18954:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658731.109586:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+6:16753:x1875544076587008:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 12003us (12196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.109598:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00010000:00010000:2.0:1788658731.229185:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658731.304286:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658731.304404:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587136 00000100:00100000:0.0:1788658731.304414:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587136 00000100:00100000:0.0:1788658731.304479:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658731.304490:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+6:16797:x1875544076587136:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:0.0:1788658731.304521:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658731.304549:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650ec595 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b313 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304616:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304631:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304646:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658731.304727:0:18952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658731.304731:0:18952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658731.304766:0:18952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304792:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78400/0xf657f176650ec595 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b313 expref: 8 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304812:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b313 expref: 7 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658731.304821:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658731.304824:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658731.304828:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78c00, rc 0) 00000100:00100000:0.0:1788658731.304892:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+7:16797:x1875544076587136:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 404us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658731.304900:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658731.420974:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658731.420998:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56e5b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103842560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658731.421088:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658731.421445:0:19640:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842560 00000100:00100000:2.0:1788658731.421454:0:19640:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842560 00000100:00100000:2.0:1788658731.421525:0:19640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658731.421536:0:19640:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103842560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788658731.421561:0:19640:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788658731.421629:0:19640:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103842560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658731.421637:0:19640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788658731.421695:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56e5b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103842560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788658731.421806:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788658732.252892:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658732.960904:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103842944:0@lo:400:kworker.0 00000100:00100000:1.0:1788658732.961025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658732.961125:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788658732.961132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103843072:0@lo:400:kworker.0 00000100:00100000:1.0:1788658732.961160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658732.961208:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842944 00000100:00100000:1.0:1788658732.961216:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842944 00000100:00100000:1.0:1788658732.961341:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658732.961363:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875544103842944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.961455:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103842688:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.961524:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658732.961572:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103843200:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.961619:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658732.961656:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788658732.961704:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.961749:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658732.961777:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103843328:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.961832:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658732.961868:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843072 00000100:00100000:2.0:1788658732.961876:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843072 00000100:00100000:2.0:1788658732.961931:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843200 00000100:00100000:2.0:1788658732.961937:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843200 00000100:00100000:2.0:1788658732.961964:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843328 00000100:00100000:2.0:1788658732.961967:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843328 00000100:00100000:2.0:1788658732.961994:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658732.962004:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103843072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.962104:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103843072:12345-0@lo:400:kworker.0 Request processed in 96us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658732.962115:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788658732.962132:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658732.962142:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103843200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.962185:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103843200:12345-0@lo:400:kworker.0 Request processed in 45us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658732.962195:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658732.962218:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788658732.962228:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103843328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658732.962437:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842816 00000100:00100000:0.0:1788658732.962445:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842816 00000100:00100000:0.0:1788658732.962505:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788658732.962522:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103842816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658732.962598:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875544103842816:12345-0@lo:400:kworker.0 Request processed in 78us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658732.962610:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788658732.963344:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103843328:12345-0@lo:400:kworker.0 Request processed in 64us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658732.963364:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788658732.963507:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658732.963515:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788658732.963572:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103843072:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.963932:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875544103842816:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.963961:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103843328:0@lo:400:kworker.0 00000100:00100000:2.0:1788658732.963982:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103843200:0@lo:400:kworker.0 00000100:00100000:1.0:1788658732.964232:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875544103842944:12345-0@lo:400:kworker.0 Request processed in 2877us (3206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658732.964245:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788658732.964294:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103842944:0@lo:400:kworker.0 00000100:00100000:3.0:1788658732.964465:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103842688 00000100:00100000:3.0:1788658732.964472:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103842688 00000100:00100000:3.0:1788658732.964512:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788658732.964520:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103842688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658732.964566:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103842688:12345-0@lo:400:kworker.0 Request processed in 47us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658732.964584:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788658732.964917:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788658732.964930:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788658732.964977:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658732.965021:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843456 00000100:00100000:0.0:1788658732.965025:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843456 00000100:00100000:0.0:1788658732.965053:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658732.965060:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103843456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788658732.965088:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788658732.965124:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875544103843456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658732.965129:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658732.965160:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56eec5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103843456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658732.967420:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103842688:0@lo:400:kworker.0 00000001:00100000:0.0:1788658733.085891:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 18e15d94-c398-4038-931d-96e7c6453e92 00000001:00100000:0.0:1788658733.085911:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788658733.085925:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000100:00100000:0.0:1788658733.274839:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.274938:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587264 00000100:00100000:2.0:1788658733.274946:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587264 00000100:00100000:2.0:1788658733.275009:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658733.275021:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:16849:x1875544076587264:12345-192.168.202.3@tcp:41:lfs.0 00000004:00000024:2.0:1788658733.275065:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788658733.275154:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:16849:x1875544076587264:12345-192.168.202.3@tcp:41:lfs.0 Request processed in 135us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.275161:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:1.0:1788658733.275542:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658733.276852:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658733.278109:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658733.278230:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587392 00000100:00100000:0.0:1788658733.278240:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587392 00000100:00100000:0.0:1788658733.279059:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658733.279071:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e15d94-c398-4038-931d-96e7c6453e92+6:16849:x1875544076587392:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:0.0:1788658733.279113:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788658733.279212:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e15d94-c398-4038-931d-96e7c6453e92+6:16849:x1875544076587392:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 143us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.279220:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00080000:1.0:1788658733.279873:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658733.281919:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658733.282038:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587520 00000100:00100000:1.0:1788658733.282048:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587520 00000100:00100000:1.0:1788658733.282152:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1788658733.282162:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e15d94-c398-4038-931d-96e7c6453e92+5:16849:x1875544076587520:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:1.0:1788658733.282188:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788658733.282287:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:18e15d94-c398-4038-931d-96e7c6453e92+5:16849:x1875544076587520:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 126us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658733.282295:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00080000:3.0:1788658733.283173:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788658733.502525:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.502623:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587648 00000100:00100000:2.0:1788658733.502634:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587648 00000100:00100000:2.0:1788658733.502725:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:2.0:1788658733.502737:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+10:16882:x1875544076587648:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658733.502754:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658733.502774:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc600/0xf657f176650ec5a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b31a expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.503968:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc600/0xf657f176650ec5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b31a expref: 11 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.503987:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc600/0xf657f176650ec5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b31a expref: 11 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.503997:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc600, rc 0) 00000100:00100000:2.0:1788658733.504149:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076587648:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 1413us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.504192:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:0.0:1788658733.511894:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.512073:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587776 00000100:00100000:3.0:1788658733.512084:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587776 00000100:00100000:3.0:1788658733.512145:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:3.0:1788658733.512155:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff955c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076587776:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788658733.512987:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff955c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076587776:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 827us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658733.512998:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:0.0:1788658733.523998:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.524237:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076587904 00000100:00100000:3.0:1788658733.524250:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076587904 00000100:00100000:3.0:1788658733.524321:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1788658733.524331:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076587904:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788658733.524716:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076587904:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 384us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658733.524725:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:0.0:1788658733.531832:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.532142:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588032 00000100:00100000:3.0:1788658733.532153:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588032 00000100:00100000:3.0:1788658733.532214:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:3.0:1788658733.532225:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16888:x1875544076588032:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788658733.532620:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16888:x1875544076588032:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 395us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658733.532628:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1788658733.543796:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.543954:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588160 00000100:00100000:2.0:1788658733.543965:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588160 00000100:00100000:2.0:1788658733.544027:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:2.0:1788658733.544047:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16888:x1875544076588160:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658733.544355:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16888:x1875544076588160:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 317us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.544363:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1788658733.546767:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658733.558412:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588288 00000100:00100000:0.0:1788658733.558431:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588288 00000100:00100000:0.0:1788658733.558528:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:0.0:1788658733.558539:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16882:x1875544076588288:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788658733.558555:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658733.558574:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac78400/0xf657f176650ec5aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b344 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658733.558602:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac78400/0xf657f176650ec5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b344 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658733.558614:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac78400/0xf657f176650ec5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b344 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658733.558624:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78400, rc 0) 00000100:00100000:0.0:1788658733.558716:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff956450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16882:x1875544076588288:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 179us (11957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.558725:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:0.0:1788658733.561107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.561173:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588416 00000100:00100000:3.0:1788658733.561182:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588416 00000100:00100000:3.0:1788658733.561235:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:3.0:1788658733.561246:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16882:x1875544076588416:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788658733.561280:0:18943:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788658733.561308:0:18943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788658733.561312:0:18943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788658733.561316:0:18943:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788658733.561318:0:18943:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:3.0:1788658733.568776:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff956050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16882:x1875544076588416:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 7520us (7670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658733.568788:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:1.0:1788658733.572219:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.572333:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588544 00000100:00100000:2.0:1788658733.572343:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588544 00000100:00100000:2.0:1788658733.572404:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:2.0:1788658733.572416:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16882:x1875544076588544:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788658733.572435:0:18946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658733.572453:0:18946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b34b expref: -99 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.572485:0:18946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 13 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.572497:0:18946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 13 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658733.572519:0:18946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd800, rc 0) 00000100:00100000:2.0:1788658733.573117:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff954850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16882:x1875544076588544:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 701us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.573124:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:0.0:1788658733.581866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.586509:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588672 00000100:00100000:3.0:1788658733.586526:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588672 00000100:00100000:2.0:1788658733.588330:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1788658733.588343:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16882:x1875544076588672:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788658733.588939:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16882:x1875544076588672:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 595us (7081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.588948:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:1.0:1788658733.591514:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.591803:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588800 00000100:00100000:2.0:1788658733.591814:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588800 00000100:00100000:2.0:1788658733.591934:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:2.0:1788658733.591946:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16882:x1875544076588800:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788658733.592309:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16882:x1875544076588800:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 363us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.592318:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:1.0:1788658733.598749:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.598939:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076588928 00000100:00100000:2.0:1788658733.598950:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076588928 00000100:00100000:2.0:1788658733.599076:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:2.0:1788658733.599088:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16892:x1875544076588928:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658733.599458:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff957c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16892:x1875544076588928:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 370us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.599467:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1788658733.608198:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.609097:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589056 00000100:00100000:2.0:1788658733.609111:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589056 00000100:00100000:2.0:1788658733.609178:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:2.0:1788658733.609190:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16892:x1875544076589056:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788658733.610541:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16892:x1875544076589056:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 1340us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.610578:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:1.0:1788658733.625507:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.627207:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589184 00000100:00100000:2.0:1788658733.627221:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589184 00000100:00100000:2.0:1788658733.627351:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658733.627360:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2350:x1875544076589184:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788658733.627390:0:20166:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 96c834a5-fc33-426e-b9d6-5502955248d0@192.168.202.3@tcp t0 exp 0000000000000000 cur 624 last 0 00000020:00000080:2.0:1788658733.627428:0:20166:0:(genops.c:1385:class_connect()) connect: client 96c834a5-fc33-426e-b9d6-5502955248d0, cookie 0xf657f176650ec5b8 00000004:00100000:2.0:1788658733.627455:0:20166:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788658733.629365:0:20166:0:(import.c:65:import_set_state_nolock()) ffff9e55c1c96800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788658733.629470:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+6:2350:x1875544076589184:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 2105us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658733.629482:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1788658733.636517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.636561:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658733.636826:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589440 00000100:00100000:0.0:1788658733.636836:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589440 00000100:00100000:0.0:1788658733.636902:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589312 00000100:00100000:0.0:1788658733.636906:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589312 00000100:00100000:0.0:1788658733.636929:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658733.636938:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+7:16882:x1875544076589440:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658733.636987:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788658733.637050:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+7:16882:x1875544076589440:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 112us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.637072:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658733.637095:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1788658733.637103:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:0:x1875544076589312:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788658733.637114:0:18953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788658733.637136:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:0:x1875544076589312:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.637143:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00080000:3.0:1788658733.637280:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658733.642083:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658733.642370:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589568 00000100:00100000:0.0:1788658733.642380:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589568 00000100:00100000:0.0:1788658733.642448:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1788658733.642459:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:16882:x1875544076589568:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788658733.642547:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:16882:x1875544076589568:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 89us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.642555:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658733.645412:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658733.645592:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589696 00000100:00100000:0.0:1788658733.645601:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589696 00000100:00100000:0.0:1788658733.645659:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1788658733.645694:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875544076589696:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788658733.645727:0:19639:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 96c834a5-fc33-426e-b9d6-5502955248d0@192.168.202.3@tcp t0 exp 0000000000000000 cur 624 last 0 00000020:00000080:0.0:1788658733.645759:0:19639:0:(genops.c:1385:class_connect()) connect: client 96c834a5-fc33-426e-b9d6-5502955248d0, cookie 0xf657f176650ec5bf 00002000:00100000:0.0:1788658733.645772:0:19639:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 96c834a5-fc33-426e-b9d6-5502955248d0/ffff9e55c1add000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788658733.645798:0:19639:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788658733.645896:0:19639:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788658733.645926:0:19639:0:(import.c:65:import_set_state_nolock()) ffff9e55c1ad8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788658733.645997:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:2350:x1875544076589696:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 304us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.646006:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1788658733.646923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658733.646963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658733.647059:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589824 00000100:00100000:2.0:1788658733.647067:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589824 00000100:00100000:2.0:1788658733.647102:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1788658733.647110:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875544076589824:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788658733.647134:0:19638:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 96c834a5-fc33-426e-b9d6-5502955248d0@192.168.202.3@tcp t0 exp 0000000000000000 cur 624 last 0 00000020:00000080:2.0:1788658733.647160:0:19638:0:(genops.c:1385:class_connect()) connect: client 96c834a5-fc33-426e-b9d6-5502955248d0, cookie 0xf657f176650ec5c6 00002000:00100000:2.0:1788658733.647168:0:19638:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 96c834a5-fc33-426e-b9d6-5502955248d0/ffff9e55c1c91800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788658733.647176:0:19638:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788658733.647388:0:19638:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788658733.647417:0:19638:0:(import.c:65:import_set_state_nolock()) ffff9e55c1c95000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788658733.647471:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96c834a5-fc33-426e-b9d6-5502955248d0+6:2350:x1875544076589824:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 360us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658733.647478:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658733.648040:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076589952 00000100:00100000:0.0:1788658733.648049:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076589952 00000100:00100000:0.0:1788658733.648106:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1788658733.648116:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96c834a5-fc33-426e-b9d6-5502955248d0+6:16882:x1875544076589952:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788658733.648184:0:18955:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658733.648303:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96c834a5-fc33-426e-b9d6-5502955248d0+6:16882:x1875544076589952:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 188us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658733.648310:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1788658733.781241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658733.781421:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590080 00000100:00100000:1.0:1788658733.781431:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590080 00000100:00100000:1.0:1788658733.781497:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1788658733.781528:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+6:16913:x1875544076590080:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:1.0:1788658733.781548:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658733.781916:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec5cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b375 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.781988:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.782003:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.782016:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658733.782117:0:20166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658733.782122:0:20166:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658733.782146:0:20166:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.782175:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec5cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 8 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.782217:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 7 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658733.782226:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:1.0:1788658733.782229:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658733.782233:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34400, rc 0) 00000100:00100000:1.0:1788658733.782309:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+7:16913:x1875544076590080:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 803us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658733.782317:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:2.0:1788658734.303526:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788658734.558471:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 96c834a5-fc33-426e-b9d6-5502955248d0 00000001:00100000:1.0:1788658734.558489:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 18e15d94-c398-4038-931d-96e7c6453e92 00010000:00010000:0.0:1788658735.325001:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788658736.348895:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658736.413083:0:20910:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788658736.541172:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103843584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658736.541283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658736.542149:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843584 00000100:00100000:3.0:1788658736.542160:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843584 00000100:00100000:3.0:1788658736.542259:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788658736.542273:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103843584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788658736.542317:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788658736.542387:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103843584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658736.542397:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788658736.542426:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788658736.542479:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103843584:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788658736.610945:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 96c834a5-fc33-426e-b9d6-5502955248d0 00000001:00100000:3.0:1788658736.610962:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 18e15d94-c398-4038-931d-96e7c6453e92 00010000:00010000:2.0:1788658737.372876:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788658737.757281:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788658738.077033:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103843840:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077162:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103844352:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077216:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788658738.077222:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103843712:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077259:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077284:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103844224:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077349:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103843968:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077372:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077389:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788658738.077394:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57008fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103844096:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658738.077446:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843840 00000100:00100000:0.0:1788658738.077454:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843840 00000100:00100000:0.0:1788658738.077506:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843968 00000100:00100000:0.0:1788658738.077509:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843968 00000100:00100000:0.0:1788658738.077540:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658738.077549:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103843840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077601:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103843840:12345-0@lo:400:kworker.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.077608:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788658738.077625:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658738.077631:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077659:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103843968:12345-0@lo:400:kworker.0 Request processed in 29us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.077713:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788658738.077731:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844352 00000100:00100000:0.0:1788658738.077734:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844352 00000100:00100000:0.0:1788658738.077756:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844224 00000100:00100000:0.0:1788658738.077758:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844224 00000100:00100000:0.0:1788658738.077768:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844096 00000100:00100000:0.0:1788658738.077770:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844096 00000100:00100000:0.0:1788658738.077782:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658738.077788:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103844352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077814:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57008ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875544103844352:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.077826:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788658738.077837:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658738.077842:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103844224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077863:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875544103844224:12345-0@lo:400:kworker.0 Request processed in 22us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.077869:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788658738.077877:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788658738.077882:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103844096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077902:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103844096:12345-0@lo:400:kworker.0 Request processed in 20us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.077907:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788658738.077929:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658738.077933:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788658738.077935:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788658738.077965:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103844096:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.077972:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788658738.077984:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103843968:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.078003:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875544103844224:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.078011:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103843840:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.078018:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875544103844352:0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.078052:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103843712 00000100:00100000:0.0:1788658738.078055:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103843712 00000100:00100000:0.0:1788658738.078075:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788658738.078081:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3307:x1875544103843712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658738.078115:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3307:x1875544103843712:12345-0@lo:400:kworker.0 Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.078121:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788658738.078151:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57008ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103843712:0@lo:400:kworker.0 00000100:00100000:1.0:1788658738.078448:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658738.078459:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103844480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788658738.078493:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658738.078561:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844480 00000100:00100000:3.0:1788658738.078565:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844480 00000100:00100000:3.0:1788658738.078597:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658738.078603:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103844480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658738.078630:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658738.078694:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103844480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658738.078700:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788658738.078726:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103844480:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788658738.149635:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 96c834a5-fc33-426e-b9d6-5502955248d0 00010000:00010000:0.0:1788658738.399169:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658738.858646:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.858749:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.858767:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.858808:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.858827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.858846:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658738.858892:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590592 00000100:00100000:3.0:1788658738.858902:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590592 00000100:00100000:3.0:1788658738.858958:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590848 00000100:00100000:3.0:1788658738.858961:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590848 00000100:00100000:3.0:1788658738.858983:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590464 00000100:00100000:3.0:1788658738.858985:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590464 00000100:00100000:3.0:1788658738.859001:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658738.859011:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076590592:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658738.859079:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076590592:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658738.859087:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1788658738.859114:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658738.859121:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076590848:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658738.859146:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076590848:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658738.859153:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658738.859164:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658738.859170:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076590464:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658738.859190:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076590464:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658738.859196:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658738.859348:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590208 00000100:00100000:3.0:1788658738.859352:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590208 00000100:00100000:3.0:1788658738.859376:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:3.0:1788658738.859382:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56c941ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:2351:x1875544076590208:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658738.859409:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56c941ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:2351:x1875544076590208:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658738.859416:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:2.0:1788658738.861584:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658738.861621:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590976 00000100:00100000:2.0:1788658738.861630:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590976 00000100:00100000:2.0:1788658738.861700:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1788658738.861711:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076590976:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658738.861775:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076590976:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 66us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658738.861782:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658738.862364:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590336 00000100:00100000:0.0:1788658738.862372:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590336 00000100:00100000:0.0:1788658738.862405:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076590720 00000100:00100000:0.0:1788658738.862409:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076590720 00000100:00100000:0.0:1788658738.862434:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:0.0:1788658738.862442:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:2351:x1875544076590336:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658738.862582:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658738.862591:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96c834a5-fc33-426e-b9d6-5502955248d0+6:2351:x1875544076590720:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1788658738.862687:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:2351:x1875544076590336:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 244us (4053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658738.862694:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00080000:0.0:1788658738.862715:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788658738.862721:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788658738.862723:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658738.862962:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96c834a5-fc33-426e-b9d6-5502955248d0+6:2351:x1875544076590720:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 371us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658738.862969:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:0.0:1788658739.420879:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788658739.433983:0:21061:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda655ccf0 20000000:00000080:0.0:1788658739.434004:0:21061:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9e56c6ca4c00 uarg=0000000000000000 20000000:01000000:0.0:1788658739.434043:0:21061:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658739.434048:0:21061:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788658739.434053:0:21061:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788658739.435086:0:21062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788658739.435393:0:21061:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788658739.442359:0:21061:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788658739.442397:0:21061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442433:0:21061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec293 expref: 18 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442441:0:21061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 18 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442448:0:21061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442457:0:21061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 12 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442464:0:21061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442470:0:21061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442522:0:21061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442540:0:21061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.442625:0:21061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844608:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658739.442953:0:21061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 12 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.442964:0:21061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 12 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.442983:0:21061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844736:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658739.443019:0:21061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.443026:0:21061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.443034:0:21061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844864:0@lo:104: 00000100:00100000:0.0:1788658739.443076:0:21061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658739.443404:0:21061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 18 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.443413:0:21061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 18 pid: 18945 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.443422:0:21061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844992:0@lo:104: 00000100:00100000:0.0:1788658739.443444:0:21061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788658739.445336:0:21061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 18 pid: 18946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658739.445353:0:21061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 18 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.445365:0:21061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103845120:0@lo:104: 00000100:00100000:0.0:1788658739.445414:0:21061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658739.445470:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844864 00000100:00100000:3.0:1788658739.445478:0:18935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844864 00000100:00100000:3.0:1788658739.445521:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103844992 00000100:00100000:3.0:1788658739.445524:0:18935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103844992 00000100:00100000:3.0:1788658739.445542:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658739.445550:0:18935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+4:21061:x1875544103844864:12345-0@lo:104: 00010000:00010000:3.0:1788658739.445564:0:18935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445625:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658739.445632:0:18935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+4:21061:x1875544103844864:12345-0@lo:104: Request processed in 83us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.445640:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658739.445658:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658739.445687:0:18935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:21061:x1875544103844992:12345-0@lo:104: 00010000:00010000:3.0:1788658739.445695:0:18935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445732:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788658739.445738:0:18935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:21061:x1875544103844992:12345-0@lo:104: Request processed in 75us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.445744:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788658739.445761:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788658739.445767:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445774:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc200 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658739.445778:0:18939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445806:0:18939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658739.445813:0:18939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658739.445820:0:18939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658739.445848:0:18939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445855:0:18939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658739.445874:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445882:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec437 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445894:0:18939:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658739.445897:0:18939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445903:0:18939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57007ef000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658739.445905:0:18939:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445912:0:18939:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658739.445919:0:18939:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658739.445930:0:18939:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658739.445945:0:18939:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445951:0:18939:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658739.445966:0:18939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445973:0:18939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e57007ef000/0xf657f176650ec2e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec2e7 expref: -99 pid: 19635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.445983:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658739.445985:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658739.445986:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658739.446006:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103845248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658739.446036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658739.446071:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103845376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658739.446094:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788658739.446203:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658739.446404:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845248 00000100:00100000:3.0:1788658739.446409:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845248 00010000:00010000:3.0:1788658739.446427:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 19 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.446450:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845376 00000100:00100000:3.0:1788658739.446452:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845376 00010000:00010000:3.0:1788658739.446465:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 20 pid: 18945 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.446476:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658739.446489:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+20:3305:x1875544103845248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658739.446500:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658739.446506:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 20 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.446515:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 20 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.446531:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658739.446562:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+20:3305:x1875544103845248:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.446568:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788658739.446584:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658739.446590:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103845376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658739.446597:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658739.446601:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 19 pid: 18945 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.446608:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 19 pid: 18945 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.446617:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658739.446641:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103845376:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.446647:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788658739.446713:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3305:1875544103845248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658739.446764:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103845376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788658739.446846:0:21061:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2480 going to sleep for 11 seconds 00010000:00010000:0.0:1788658739.446860:0:21061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79600/0xf657f176650ec437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec430 expref: 18 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.446883:0:21061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844864:0@lo:104: 00010000:00010000:0.0:1788658739.446894:0:21061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed34200/0xf657f176650ec2e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec2e0 expref: 17 pid: 18945 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.446902:0:21061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844992:0@lo:104: 00000100:00100000:3.0:1788658739.447024:0:18935:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788658739.447042:0:18935:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845120 00000100:00100000:3.0:1788658739.447045:0:18935:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845120 00000100:00100000:3.0:1788658739.447065:0:18935:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658739.447071:0:18935:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fc60b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:21061:x1875544103845120:12345-0@lo:104: 00010000:00010000:3.0:1788658739.447081:0:18935:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447138:0:18935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788658739.447143:0:18935:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fc60b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+3:21061:x1875544103845120:12345-0@lo:104: Request processed in 73us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.447150:0:18935:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788658739.447188:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658739.447193:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447199:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79000 already unused, calling callback (ffffffffc1c27c20) 10000000:00010000:3.0:1788658739.447202:0:18940:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447209:0:18940:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788658739.447216:0:18940:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658739.447221:0:18940:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788658739.447255:0:18940:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447262:0:18940:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788658739.447283:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447290:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff9e56fac79000/0xf657f176650ec293 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf657f176650ec29a expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447305:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658739.447307:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658739.447308:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788658739.447319:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103845504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788658739.447350:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658739.447382:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845504 00000100:00100000:3.0:1788658739.447386:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845504 00010000:00010000:3.0:1788658739.447399:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 17 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.447418:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658739.447423:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:3307:x1875544103845504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788658739.447430:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658739.447434:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 17 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447443:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 17 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.447453:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658739.447475:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:3307:x1875544103845504:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.447481:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788658739.447522:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3307:1875544103845504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788658739.447661:0:21061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56eed35200/0xf657f176650ec29a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf657f176650ec293 expref: 16 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658739.447716:0:21061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103845120:0@lo:104: 00000100:00100000:2.0:1788658739.454030:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658739.454116:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658739.454254:0:21061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844608:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658739.454269:0:21061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21061:1875544103844736:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658739.454307:0:21061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.454532:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591232 00000100:00100000:3.0:1788658739.454539:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591232 00010000:00010000:3.0:1788658739.454579:0:18937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 13 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.454612:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591104 00000100:00100000:3.0:1788658739.454615:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591104 00010000:00010000:3.0:1788658739.454627:0:18937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 14 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658739.454642:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658739.454649:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d29274b-714d-4f7c-845d-b6bb1e24047c+14:2352:x1875544076591232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658739.454694:0:18937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658739.454701:0:18937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 14 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454712:0:18937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 14 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454729:0:18937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec579 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b2e9 expref: 14 pid: 18943 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454744:0:18937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658739.454799:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:2352:x1875544076591232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.454807:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658739.454825:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658739.454844:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:2352:x1875544076591104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658739.454868:0:18937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658739.454873:0:18937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454883:0:18937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454893:0:18937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56ff3cd800/0xf657f176650ec5b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b34b expref: 12 pid: 18946 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454904:0:18937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454912:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454926:0:18937:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454933:0:18937:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454940:0:18937:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.454947:0:18937:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.455500:0:18937:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658739.455507:0:18937:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.455529:0:18937:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.455550:0:18937:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658739.455561:0:18937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658739.455684:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:2352:x1875544076591104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 831us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658739.455694:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00010000:00010000:1.0:1788658739.455812:0:21061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658739.455820:0:21061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658739.455825:0:21061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9e56fac79c00/0xf657f176650ec5db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.449430:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788658740.509595:0:18948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658740.509604:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56deaab000 from 10 10000000:01000000:3.0:1788658740.509611:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658740.509684:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.509695:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.509707:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.509733:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.509800:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658740.509874:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196240 going to sleep for 11 seconds 00000100:00100000:0.0:1788658740.510030:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845632 00000100:00100000:0.0:1788658740.510038:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845632 00000100:00100000:0.0:1788658740.510094:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788658740.510104:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+16:18948:x1875544103845632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788658740.510117:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658740.510132:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec5e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec5e2 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.510155:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec5e2 expref: 17 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.510164:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56fac79e00/0xf657f176650ec5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec5e2 expref: 17 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.510175:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79e00, rc 0) 00000100:00100000:0.0:1788658740.510245:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103845632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658740.510253:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788658740.510570:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658740.510598:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5e9 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.510608:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec5e9 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658740.510695:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788658740.510726:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658740.510758:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788658740.510865:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845760 00000100:00100000:3.0:1788658740.510871:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845760 00000100:00100000:3.0:1788658740.510908:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788658740.510925:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103845760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.511526:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103845760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 601us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658740.511535:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788658740.514995:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.515070:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.515152:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658740.515293:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c1254180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658740.522035:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103845888 00000100:00100000:0.0:1788658740.522055:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103845888 00000100:00100000:0.0:1788658740.522131:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788658740.522142:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103845888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788658740.523449:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103845888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1303us (8291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658740.523460:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788658740.523721:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103845888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788658740.528906:0:21074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788658740.530480:0:18948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788658740.530510:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788658740.530522:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5e9 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658740.530536:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacc200/0xf657f176650ec5e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5e9 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788658740.530556:0:18948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788658740.530559:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56d183a800 from 10 10000000:01000000:2.0:1788658740.530562:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788658740.530610:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658740.530618:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658740.530628:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658740.530651:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.530746:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658740.530783:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658740.530860:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846016 00000100:00100000:1.0:1788658740.530868:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846016 00000100:00100000:1.0:1788658740.530908:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788658740.530916:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+17:18948:x1875544103846016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658740.530928:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658740.530940:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed35c00/0xf657f176650ec5f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec5f0 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.530964:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35c00/0xf657f176650ec5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec5f0 expref: 18 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.530975:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed35c00/0xf657f176650ec5f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec5f0 expref: 18 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.530984:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35c00, rc 0) 00000100:00100000:1.0:1788658740.531017:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.531037:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788658740.534503:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658740.534535:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5f7 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658740.534560:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec5f7 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658740.534706:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.534765:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658740.534812:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788658740.535075:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846144 00000100:00100000:3.0:1788658740.535083:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846144 00000100:00100000:3.0:1788658740.535136:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788658740.535146:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.535424:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658740.535433:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788658740.535768:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.535800:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.535856:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658740.535889:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d051ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788658740.535946:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846272 00000100:00100000:1.0:1788658740.535951:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846272 00000100:00100000:1.0:1788658740.535984:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788658740.535991:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658740.536129:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.536136:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788658740.536727:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fefd8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788658740.540496:0:21075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788658740.540848:0:18948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788658740.540872:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788658740.540885:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5f7 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.540896:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56ff3cd800/0xf657f176650ec5f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec5f7 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788658740.540908:0:18948:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788658740.540911:0:18948:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9e56eee1b000 from 10 10000000:01000000:3.0:1788658740.540914:0:18948:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788658740.540954:0:18948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.540961:0:18948:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.540971:0:18948:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.541004:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.541073:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658740.541123:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658740.541194:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846400 00000100:00100000:1.0:1788658740.541202:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846400 00000100:00100000:1.0:1788658740.541269:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788658740.541279:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+18:18948:x1875544103846400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788658740.541295:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658740.541322:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec605 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf657f176650ec5fe expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.541348:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf657f176650ec5fe expref: 19 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.541359:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56eed35a00/0xf657f176650ec605 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf657f176650ec5fe expref: 19 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.541369:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35a00, rc 0) 00000100:00100000:1.0:1788658740.541410:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103846400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.541416:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788658740.542705:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788658740.542725:0:18948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec605 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.542736:0:18948:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf657f176650ec605 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.542801:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.542842:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658740.542877:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196240 going to sleep for 11 seconds 00000100:00100000:2.0:1788658740.543406:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846528 00000100:00100000:2.0:1788658740.543414:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846528 00000100:00100000:2.0:1788658740.543495:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788658740.543506:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103846528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788658740.543851:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103846528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658740.543860:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788658740.543941:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.543976:0:18948:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788658740.544016:0:18948:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658740.558818:0:18948:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c8196240 going to sleep for 11 seconds 00000100:00100000:1.0:1788658740.565930:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103846656 00000100:00100000:1.0:1788658740.565969:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103846656 00000100:00100000:1.0:1788658740.566041:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788658740.566052:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103846656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658740.567248:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:18948:x1875544103846656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1183us (23216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.567261:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788658740.567577:0:18948:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e570056ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4b7533a2-f0ee-43c1-8561-a2cc551aa877:18948:1875544103846656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788658740.568985:0:21076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788658740.569421:0:18948:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788658740.569443:0:18948:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788658740.569456:0:18948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec605 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.569468:0:18948:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff9e56deacc400/0xf657f176650ec5fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf657f176650ec605 expref: -99 pid: 18948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658740.754702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.754812:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591360 00000100:00100000:0.0:1788658740.754823:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591360 00000100:00100000:0.0:1788658740.754904:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1788658740.754915:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:17375:x1875544076591360:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658740.754938:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658740.754959:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec60c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b37c expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755026:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755040:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755052:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755066:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755072:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755097:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755428:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ec621 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755438:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ec621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755446:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ec621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658740.755469:0:18953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658740.755473:0:18953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658740.755504:0:18953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ec621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755513:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755519:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755524:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755529:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.755533:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755540:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755558:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658740.755560:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.755565:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755571:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec613 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755584:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755590:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755596:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755601:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.755603:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755608:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755613:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658740.755615:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.755617:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755622:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec61a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755743:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec60c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b37c expref: 8 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755758:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78200/0xf657f176650ec621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b37c expref: 7 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.755766:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658740.755768:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658740.755771:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac78200, rc 0) 00000100:00100000:0.0:1788658740.755826:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:17375:x1875544076591360:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 914us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658740.755834:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00080000:2.0:1788658740.757878:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658740.771081:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.771213:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591616 00000100:00100000:0.0:1788658740.771223:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591616 00000100:00100000:0.0:1788658740.771324:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1788658740.771334:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+7:17375:x1875544076591616:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788658740.771356:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658740.771380:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec628 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b383 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771462:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771477:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771490:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771522:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771529:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.771536:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772093:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8400/0xf657f176650ec63d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772104:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8400/0xf657f176650ec63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772112:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8400/0xf657f176650ec63d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658740.772122:0:18952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788658740.772343:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772352:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772359:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772364:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.772368:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772386:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772400:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9e56c3c69f00) 00010000:00010000:0.0:1788658740.772403:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.772408:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772415:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec62f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772429:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772435:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772440:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772444:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.772447:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772452:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772458:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658740.772460:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.772463:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.772476:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec636 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.774262:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec628 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b383 expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.774288:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8400/0xf657f176650ec63d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b383 expref: 9 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.774297:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69b00) 00010000:00010000:0.0:1788658740.774299:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.774302:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8400, rc 0) 00000100:00100000:0.0:1788658740.774697:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+9:17375:x1875544076591616:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 3361us (3625us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788658740.774707:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1788658740.780595:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.780784:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591744 00000100:00100000:0.0:1788658740.780806:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591744 00000100:00100000:0.0:1788658740.780860:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658740.780870:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+9:17375:x1875544076591744:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788658740.780977:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+9:17375:x1875544076591744:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658740.780984:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1788658740.812149:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.813173:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076591872 00000100:00100000:0.0:1788658740.813186:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076591872 00000100:00100000:0.0:1788658740.813264:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1788658740.813274:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+9:17381:x1875544076591872:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658740.813306:0:18951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658740.813328:0:18951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec64b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b38a expref: -99 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813389:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813403:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813415:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813429:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813436:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813443:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813898:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813907:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813912:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813916:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8e00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.813926:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813934:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813946:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658740.813948:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.813952:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813959:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813971:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813977:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813981:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813985:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658740.813987:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813992:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.813998:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658740.814000:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.814008:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.814014:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec659 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.814047:0:18951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec64b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b38a expref: 10 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.814057:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658740.814059:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658740.814062:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec64b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b38a expref: 10 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.814071:0:18951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8a00, rc 0) 00000100:00100000:0.0:1788658740.814135:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+9:17381:x1875544076591872:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 863us (2000us total) trans 0 rc 301/301 00000100:00100000:0.0:1788658740.814143:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1788658740.819639:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658740.819962:0:18960:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592000 00000100:00100000:1.0:1788658740.819974:0:18960:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592000 00000100:00100000:1.0:1788658740.820033:0:18960:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658740.820043:0:18960:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:18e15d94-c398-4038-931d-96e7c6453e92+9:17381:x1875544076592000:12345-192.168.202.3@tcp:700:lfs.0 00000100:00100000:1.0:1788658740.820137:0:18960:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:18e15d94-c398-4038-931d-96e7c6453e92+9:17381:x1875544076592000:12345-192.168.202.3@tcp:700:lfs.0 Request processed in 95us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.820145:0:18960:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658740.825052:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.825327:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592256 00000100:00100000:0.0:1788658740.825339:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592256 00000100:00100000:0.0:1788658740.825397:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:0.0:1788658740.825406:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+9:17381:x1875544076592256:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:0.0:1788658740.825458:0:18953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658740.825483:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec59c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b313 expref: 9 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.825503:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:0.0:1788658740.825508:0:18953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658740.829956:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.829985:0:18953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 5 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.830006:0:18953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.830047:0:18953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 5 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.830064:0:18953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 5 pid: 20166 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658740.830079:0:18953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18953:1875544103846784:192.168.202.3@tcp:104: 00000100:00100000:1.0:1788658740.830183:0:18953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e55c28a40c0 going to sleep for 11 seconds 00000040:00080000:0.0:1788658740.831202:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788658740.838016:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658740.838151:0:18953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57007e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18953:1875544103846784:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658740.838178:0:18953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.844879:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592384 00000100:00100000:3.0:1788658740.844895:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592384 00010000:00010000:3.0:1788658740.844965:0:18937:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 6 pid: 20166 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.845040:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1788658740.845051:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96c834a5-fc33-426e-b9d6-5502955248d0+6:2352:x1875544076592384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658740.845068:0:18937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658740.845076:0:18937:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 6 pid: 20166 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845092:0:18937:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 6 pid: 20166 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845117:0:18937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34400/0xf657f176650ec5d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b375 expref: 6 pid: 20166 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845139:0:18937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:3.0:1788658740.845146:0:18937:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845155:0:18937:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845163:0:18937:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845191:0:18937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658740.845264:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96c834a5-fc33-426e-b9d6-5502955248d0+5:2352:x1875544076592384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 215us (7260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658740.845272:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00010000:00010000:3.0:1788658740.845432:0:18953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845446:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845468:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845478:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.845486:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658740.847332:0:18953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788658740.847350:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847360:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847367:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847373:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658740.847377:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847385:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847400:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69800) 00010000:00010000:3.0:1788658740.847402:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658740.847416:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.847423:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec660 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788658740.847446:0:18953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087e14033 reply state 000000002c284a94 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.847455:0:18953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658740.847564:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+10:17381:x1875544076592256:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 22155us (22522us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788658740.847574:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00080000:1.0:1788658740.848456:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788658740.853331:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853353:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853361:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853368:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacd600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658740.853372:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853380:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853399:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e56c55f1200) 00010000:00010000:3.0:1788658740.853402:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658740.853408:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658740.853427:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec667 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658740.948926:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658740.949084:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592512 00000100:00100000:0.0:1788658740.949094:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592512 00000100:00100000:0.0:1788658740.949158:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1788658740.949168:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+9:17389:x1875544076592512:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:0.0:1788658740.949190:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658740.949212:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec66e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b391 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949291:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec675 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949318:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949332:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658740.949369:0:18952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658740.949373:0:18952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658740.949411:0:18952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec675 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949435:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec66e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b391 expref: 11 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949454:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8e00/0xf657f176650ec675 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b391 expref: 10 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658740.949462:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658740.949479:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788658740.949483:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d8e00, rc 0) 00000100:00100000:0.0:1788658740.949545:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+10:17389:x1875544076592512:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 378us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658740.949552:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1788658740.980470:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658740.980636:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592640 00000100:00100000:1.0:1788658740.980647:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592640 00000100:00100000:1.0:1788658740.980739:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1788658740.980751:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+5:17390:x1875544076592640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658740.980776:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658740.980899:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec67c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b398 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.980977:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34800/0xf657f176650ec683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.981010:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34800/0xf657f176650ec683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.981023:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34800/0xf657f176650ec683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658740.981061:0:20166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658740.981064:0:20166:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658740.981087:0:20166:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34800/0xf657f176650ec683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.981116:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b398 expref: 7 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.981135:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34800/0xf657f176650ec683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b398 expref: 6 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.981143:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:1.0:1788658740.981146:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658740.981149:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34800, rc 0) 00000100:00100000:1.0:1788658740.981218:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+6:17390:x1875544076592640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 469us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.981225:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1788658740.983644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658740.983718:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076592768 00000100:00100000:1.0:1788658740.983728:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076592768 00000100:00100000:1.0:1788658740.983779:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1788658740.983790:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96c834a5-fc33-426e-b9d6-5502955248d0+6:17390:x1875544076592768:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658740.983823:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658740.983859:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec68a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b39f expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983920:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983935:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983947:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983960:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983967:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.983973:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984064:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984073:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984081:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658740.984108:0:18952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788658740.984111:0:18952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658740.984129:0:18952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984149:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984155:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984161:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984167:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658740.984171:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984179:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984190:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:1.0:1788658740.984193:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658740.984198:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984204:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984218:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984224:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984229:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984251:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658740.984255:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984261:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984270:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e56c3c59100) 00010000:00010000:1.0:1788658740.984273:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658740.984276:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984282:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec698 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984328:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec68a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b39f expref: 8 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984343:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b39f expref: 7 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.984350:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c59500) 00010000:00010000:1.0:1788658740.984352:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788658740.984354:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34e00, rc 0) 00000100:00100000:1.0:1788658740.984420:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:96c834a5-fc33-426e-b9d6-5502955248d0+7:17390:x1875544076592768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 631us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658740.984428:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1788658740.988992:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658740.989072:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593024 00000100:00100000:1.0:1788658740.989097:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593024 00000100:00100000:1.0:1788658740.989162:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:1.0:1788658740.989172:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+7:17390:x1875544076593024:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1788658740.989195:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658740.989217:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec6a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3a6 expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658740.989393:0:20166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788658740.989655:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec6a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3a6 expref: 9 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.989713:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:1.0:1788658740.989717:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788658740.989723:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec6a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3a6 expref: 9 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658740.989735:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed35200, rc 0) 00000100:00100000:1.0:1788658740.989980:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:96c834a5-fc33-426e-b9d6-5502955248d0+8:17390:x1875544076593024:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 807us (998us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1788658740.989988:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1788658741.007492:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.007654:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593280 00000100:00100000:0.0:1788658741.007709:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593280 00000100:00100000:0.0:1788658741.007764:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:0.0:1788658741.007774:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96c834a5-fc33-426e-b9d6-5502955248d0+8:17390:x1875544076593280:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:0.0:1788658741.007832:0:18951:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658741.007860:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec69f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b39f expref: 8 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.007882:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c59500) 00010000:00010000:0.0:1788658741.007893:0:18951:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788658741.007921:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.007937:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.007947:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658741.008192:0:18951:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000eb324d1 reply state 000000009cfbb307 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.008347:0:18951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788658741.008358:0:18951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788658741.008459:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593280:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 685us (979us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788658741.008482:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:0.0:1788658741.016479:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.016567:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593408 00000100:00100000:3.0:1788658741.016579:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593408 00000100:00100000:3.0:1788658741.016705:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:3.0:1788658741.016716:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593408:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658741.016742:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.016765:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec6bb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3ad expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.016870:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.016885:0:18953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.016892:0:18953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.016910:0:18953:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.016920:0:18953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017399:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017409:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017416:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017441:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.017445:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017453:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017467:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:1.0:1788658741.017470:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788658741.017473:0:3290:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017481:0:3290:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017488:0:3290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017520:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.017527:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6b4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.017647:0:18953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.017662:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658741.017721:0:18953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788658741.017725:0:18953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788658741.017743:0:18953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.017775:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec6bb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 10 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.017789:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 9 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.017796:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:3.0:1788658741.017799:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788658741.017802:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacd000, rc 0) 00000100:00100000:3.0:1788658741.018195:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593408:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1479us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.018214:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1788658741.025484:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.025649:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593536 00000100:00100000:0.0:1788658741.025660:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593536 00000100:00100000:0.0:1788658741.025762:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658741.025772:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593536:12345-192.168.202.3@tcp:37:lfs.0 00000100:00100000:0.0:1788658741.034330:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593536:12345-192.168.202.3@tcp:37:lfs.0 Request processed in 8543us (8843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.034344:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1788658741.037799:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.037931:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593792 00000100:00100000:3.0:1788658741.037941:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593792 00000100:00100000:3.0:1788658741.037990:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1788658741.037999:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96c834a5-fc33-426e-b9d6-5502955248d0+9:17390:x1875544076593792:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1788658741.040165:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:96c834a5-fc33-426e-b9d6-5502955248d0+10:17390:x1875544076593792:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 2155us (2366us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788658741.040179:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:2.0:1788658741.096650:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.096838:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076593920 00000100:00100000:0.0:1788658741.096860:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076593920 00000100:00100000:0.0:1788658741.096926:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:0.0:1788658741.096937:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+10:17396:x1875544076593920:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658741.096960:0:18951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658741.096981:0:18951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ec6c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3b4 expref: -99 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097048:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097062:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097074:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097091:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097114:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097121:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097227:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6de lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097246:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097255:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658741.097282:0:18951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788658741.097286:0:18951:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658741.097326:0:18951:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6de lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097339:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097345:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097352:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097358:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658741.097363:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097378:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097392:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:0.0:1788658741.097395:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658741.097400:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097407:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9c00/0xf657f176650ec6d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097422:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097428:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097433:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097438:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658741.097441:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097446:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097453:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9e56c3c69700) 00010000:00010000:0.0:1788658741.097456:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658741.097458:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097474:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec6d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097508:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ec6c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3b4 expref: 12 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097522:0:18951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9200/0xf657f176650ec6de lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3b4 expref: 11 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.097529:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:0.0:1788658741.097532:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788658741.097534:0:18951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9200, rc 0) 00000100:00100000:0.0:1788658741.098756:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fefd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+11:17396:x1875544076593920:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1812us (2111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.098766:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1788658741.102641:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.102768:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594176 00000100:00100000:0.0:1788658741.102779:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594176 00000100:00100000:0.0:1788658741.102842:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1788658741.102851:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+11:17396:x1875544076594176:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658741.102872:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658741.102893:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec6e5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3bb expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.103006:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.103021:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 9 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.103047:0:20166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.103082:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 9 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.103096:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 9 pid: 18953 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.103111:0:20166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103846912:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658741.103214:0:20166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788658741.105904:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.106164:0:20166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103846912:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658741.106193:0:20166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658741.106354:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594304 00000100:00100000:2.0:1788658741.106362:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594304 00010000:00010000:2.0:1788658741.106395:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 10 pid: 18953 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658741.106436:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1788658741.106447:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96c834a5-fc33-426e-b9d6-5502955248d0+10:2351:x1875544076594304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658741.106461:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658741.106467:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 10 pid: 18953 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106480:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 10 pid: 18953 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106515:0:18936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd000/0xf657f176650ec6c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ad expref: 10 pid: 18953 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106534:0:18936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:2.0:1788658741.106539:0:18936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106548:0:18936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106555:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.106603:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658741.106760:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57007e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96c834a5-fc33-426e-b9d6-5502955248d0+9:2351:x1875544076594304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 313us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.106767:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00010000:00010000:0.0:1788658741.109725:0:20166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.109746:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.109825:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.109840:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.109853:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110780:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110792:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110800:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658741.110813:0:20166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788658741.110844:0:20166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110852:0:20166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110859:0:20166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110865:0:20166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658741.110870:0:20166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110878:0:20166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110891:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:0.0:1788658741.110894:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788658741.110899:0:20166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.110919:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec6ec lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788658741.110935:0:20166:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb4ebeaf reply state 000000007640a18e transno 12884901894 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.110944:0:20166:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788658741.110988:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d8a00/0xf657f176650ec6e5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.111005:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 13 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.111013:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.111015:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788658741.111019:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79600, rc 0) 00000100:00100000:0.0:1788658741.111081:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+14:17396:x1875544076594176:12345-192.168.202.3@tcp:101:bash.0 Request processed in 8230us (8451us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788658741.111089:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00010000:00010000:3.0:1788658741.122487:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122508:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122516:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122522:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac79c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658741.122527:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122536:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122564:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9e56c3c69700) 00010000:00010000:3.0:1788658741.122569:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788658741.122574:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.122581:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec6f3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658741.144813:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.145245:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594432 00000100:00100000:0.0:1788658741.145256:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594432 00000100:00100000:0.0:1788658741.145323:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1788658741.145333:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+13:17396:x1875544076594432:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1788658741.145357:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658741.145378:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec708 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3c2 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145470:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145486:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145498:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658741.145535:0:18952:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788658741.145540:0:18952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788658741.145749:0:18952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145762:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145786:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec708 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 15 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145805:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.145815:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.145817:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658741.145821:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79000, rc 0) 00000100:00100000:0.0:1788658741.146017:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+14:17396:x1875544076594432:12345-192.168.202.3@tcp:101:bash.0 Request processed in 684us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.146025:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1788658741.149157:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.149323:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594688 00000100:00100000:0.0:1788658741.149334:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594688 00000100:00100000:0.0:1788658741.149429:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:0.0:1788658741.149439:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff376850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+14:17396:x1875544076594688:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:0.0:1788658741.150783:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff376850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+15:17396:x1875544076594688:12345-192.168.202.3@tcp:35:bash.0 Request processed in 1338us (1630us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788658741.150794:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1788658741.224765:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658741.224917:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594816 00000100:00100000:2.0:1788658741.224928:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594816 00000100:00100000:2.0:1788658741.224992:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1788658741.225003:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+11:16767:x1875544076594816:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658741.225030:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658741.225050:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cd000/0xf657f176650ec716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3c9 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.225079:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cd000/0xf657f176650ec716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c9 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.225090:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cd000/0xf657f176650ec716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c9 expref: 12 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.225101:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cd000, rc 0) 00000100:00100000:2.0:1788658741.225167:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076594816:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 165us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.225175:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:1.0:1788658741.227432:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.227538:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076594944 00000100:00100000:0.0:1788658741.227557:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076594944 00000100:00100000:0.0:1788658741.227614:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:0.0:1788658741.227624:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076594944:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658741.227938:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076594944:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 314us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.227947:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:3.0:1788658741.234626:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.234824:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595072 00000100:00100000:1.0:1788658741.234851:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595072 00000100:00100000:1.0:1788658741.234912:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:1.0:1788658741.234922:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076595072:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658741.235166:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076595072:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 244us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.235174:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:1.0:1788658741.250783:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658741.251387:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595200 00000100:00100000:2.0:1788658741.251401:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595200 00000100:00100000:2.0:1788658741.251469:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1788658741.251481:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+12:16767:x1875544076595200:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788658741.251518:0:18945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658741.251540:0:18945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9e56ff3cc200/0xf657f176650ec71d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3d0 expref: -99 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.251583:0:18945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9e56ff3cc200/0xf657f176650ec71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3d0 expref: 13 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.251594:0:18945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9e56ff3cc200/0xf657f176650ec71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3d0 expref: 13 pid: 18945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.251603:0:18945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc200, rc 0) 00000100:00100000:2.0:1788658741.251702:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16767:x1875544076595200:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 223us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.251710:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1788658741.254143:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.256768:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595328 00000100:00100000:0.0:1788658741.256786:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595328 00000100:00100000:0.0:1788658741.256950:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1788658741.256961:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16767:x1875544076595328:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788658741.259317:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16767:x1875544076595328:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 2341us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.259334:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:3.0:1788658741.264007:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.264132:0:18943:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595456 00000100:00100000:1.0:1788658741.264143:0:18943:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595456 00000100:00100000:1.0:1788658741.264197:0:18943:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1788658741.264220:0:18943:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16767:x1875544076595456:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788658741.264502:0:18943:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:16767:x1875544076595456:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 295us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.264511:0:18943:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1788658741.271977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.272281:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595712 00000100:00100000:3.0:1788658741.272293:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595712 00000100:00100000:3.0:1788658741.272362:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:3.0:1788658741.272373:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+15:17406:x1875544076595712:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1788658741.272406:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.272445:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec724 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3d7 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658741.272540:0:18953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788658741.273144:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec724 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3d7 expref: 17 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.273162:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9e56c3c69a00) 00010000:00010000:3.0:1788658741.273166:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658741.273172:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec724 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3d7 expref: 17 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.273188:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacd600, rc 0) 00000100:00100000:3.0:1788658741.273347:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+16:17406:x1875544076595712:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 974us (1389us total) trans 12884901896 rc 301/301 00000100:00100000:3.0:1788658741.273356:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:3.0:1788658741.277354:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.277480:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076595968 00000100:00100000:0.0:1788658741.277490:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076595968 00000100:00100000:0.0:1788658741.277575:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658741.277586:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+16:17406:x1875544076595968:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658741.277924:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+17:17406:x1875544076595968:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 338us (582us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788658741.277931:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1788658741.327219:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.327409:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076596224 00000100:00100000:0.0:1788658741.327420:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076596224 00000100:00100000:0.0:1788658741.327489:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1788658741.327501:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+17:17411:x1875544076596224:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1788658741.327539:0:18951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658741.327569:0:18951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec732 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3de expref: -99 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.327733:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec739 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.327749:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec739 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.327760:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec739 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788658741.327772:0:18951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788658741.327908:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec732 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3de expref: 20 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.327928:0:18951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec739 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3de expref: 19 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.327937:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.327957:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788658741.327962:0:18951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56fac79c00, rc 0) 00000100:00100000:0.0:1788658741.328300:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+19:17411:x1875544076596224:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 800us (1103us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788658741.328309:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:1.0:1788658741.334286:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.334335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.334476:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076596352 00000100:00100000:0.0:1788658741.334489:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076596352 00000100:00100000:0.0:1788658741.334578:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1788658741.334588:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+19:17411:x1875544076596352:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1788658741.334661:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334713:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334725:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334756:0:20166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334763:0:20166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334769:0:20166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334774:0:20166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56fac78c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:0.0:1788658741.334779:0:20166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334806:0:20166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334818:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.334821:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788658741.334826:0:20166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.334833:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac78c00/0xf657f176650ec747 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.334906:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+19:17411:x1875544076596352:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 319us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.334914:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:3.0:1788658741.335770:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076596480 00000100:00100000:3.0:1788658741.335781:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076596480 00000100:00100000:3.0:1788658741.335836:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1788658741.335845:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+19:2352:x1875544076596480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658741.335857:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658741.335876:0:18938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79c00/0xf657f176650ec739 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3de expref: 19 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.335892:0:18938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.335896:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658741.335957:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+18:2352:x1875544076596480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 113us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.335964:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658741.339188:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.339727:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076596736 00000100:00100000:0.0:1788658741.339743:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076596736 00000100:00100000:0.0:1788658741.339812:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:0.0:1788658741.339824:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+18:17411:x1875544076596736:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1788658741.340154:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+19:17411:x1875544076596736:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 330us (977us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788658741.340162:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00010000:00010000:2.0:1788658741.469629:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788658741.664768:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788658741.664798:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103847040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788658741.664893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658741.664971:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103847040 00000100:00100000:1.0:1788658741.664980:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103847040 00000100:00100000:1.0:1788658741.665043:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788658741.665053:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103847040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788658741.665093:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788658741.665154:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875544103847040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.665161:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788658741.665185:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788658741.665218:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700422a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875544103847040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788658741.701515:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.701617:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076596992 00000100:00100000:3.0:1788658741.701629:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076596992 00000100:00100000:3.0:1788658741.701728:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:3.0:1788658741.701739:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+19:17442:x1875544076596992:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1788658741.701962:0:18951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.701986:0:18951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec74e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3e5 expref: -99 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.702106:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec755 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.702123:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec755 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.702137:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec755 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658741.702149:0:18951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788658741.702428:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec74e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3e5 expref: 22 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.702449:0:18951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec755 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3e5 expref: 21 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.702458:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.702477:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788658741.702482:0:18951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacc600, rc 0) 00000100:00100000:3.0:1788658741.702722:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+21:17442:x1875544076596992:12345-192.168.202.3@tcp:101:cat.0 Request processed in 982us (1220us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788658741.702731:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:0.0:1788658741.708955:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.710888:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076597248 00000100:00100000:3.0:1788658741.710902:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076597248 00000100:00100000:3.0:1788658741.710955:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1788658741.710964:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+21:17442:x1875544076597248:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1788658741.711311:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+22:17442:x1875544076597248:12345-192.168.202.3@tcp:35:cat.0 Request processed in 338us (2358us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788658741.711320:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:1.0:1788658741.724278:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.726099:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076597376 00000100:00100000:3.0:1788658741.726112:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076597376 00000100:00100000:3.0:1788658741.726169:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1788658741.726177:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e15d94-c398-4038-931d-96e7c6453e92+22:2354:x1875544076597376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658741.726190:0:18937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658741.726212:0:18937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec755 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3e5 expref: 22 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.726228:0:18937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.726242:0:18937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658741.726420:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e15d94-c398-4038-931d-96e7c6453e92+21:2354:x1875544076597376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 241us (2152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.726428:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000001:00080000:2.0:1788658741.731062:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901899 is committed 00000001:00080000:2.0:1788658741.731086:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:2.0:1788658741.731177:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901893 is committed 00000100:00100000:3.0:1788658741.779381:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.779819:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076597632 00000100:00100000:0.0:1788658741.779831:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076597632 00000100:00100000:0.0:1788658741.779895:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1788658741.779906:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+13:17448:x1875544076597632:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:0.0:1788658741.779931:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788658741.779961:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ec763 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3ec expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780081:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780097:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780106:0:20166:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780114:0:20166:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780149:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780165:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 14 pid: 18952 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.780179:0:20166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac61180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103847168:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658741.780312:0:20166:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.780323:0:20166:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.780332:0:20166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103847296:192.168.202.3@tcp:104: 00000100:00100000:0.0:1788658741.780369:0:20166:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ca6cba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788658741.785977:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.786129:0:20166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac61180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103847168:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658741.786199:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076597760 00000100:00100000:2.0:1788658741.786206:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076597760 00010000:00010000:2.0:1788658741.786254:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 15 pid: 18952 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658741.786295:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1788658741.786303:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570052e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+15:2352:x1875544076597760:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788658741.786321:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658741.786342:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 15 pid: 18952 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.786355:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 15 pid: 18952 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.786378:0:18936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79000/0xf657f176650ec70f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3c2 expref: 15 pid: 18952 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.786395:0:18936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:2.0:1788658741.786400:0:18936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.786409:0:18936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.786416:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658741.786469:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570052e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+14:2352:x1875544076597760:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 167us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.786475:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1788658741.789088:0:20166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20166:1875544103847296:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658741.789119:0:20166:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658741.790075:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.790302:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076597888 00000100:00100000:0.0:1788658741.790311:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076597888 00010000:00010000:0.0:1788658741.790348:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.790382:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1788658741.790390:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+14:2351:x1875544076597888:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658741.790404:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658741.790411:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790423:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790445:0:18938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56fac79600/0xf657f176650ec6fa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3bb expref: 14 pid: 20166 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790463:0:18938:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.790467:0:18938:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790496:0:18938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790514:0:18938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.790547:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658741.790606:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+13:2351:x1875544076597888:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 215us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.790613:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00010000:00010000:1.0:1788658741.790811:0:20166:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.790820:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658741.790841:0:20166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788658741.791007:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9600/0xf657f176650ec763 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ec expref: 14 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.791023:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e57021d9800/0xf657f176650ec76a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3ec expref: 13 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.791030:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:1.0:1788658741.791033:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788658741.791036:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e57021d9800, rc 0) 00000100:00100000:1.0:1788658741.791078:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+13:17448:x1875544076597632:12345-192.168.202.3@tcp:101:dd.0 Request processed in 11174us (11712us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1788658741.791086:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1788658741.794604:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.794836:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598144 00000100:00100000:3.0:1788658741.794846:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598144 00000100:00100000:3.0:1788658741.794905:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1788658741.794915:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+13:17448:x1875544076598144:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:3.0:1788658741.795200:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.795219:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.795230:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658741.795295:0:18951:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901903 00000004:00010000:3.0:1788658741.795321:0:18951:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f0c5609 reply state 000000009038b504 transno 12884901904 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658741.795331:0:18951:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658741.795419:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:17448:x1875544076598144:12345-192.168.202.3@tcp:36:dd.0 Request processed in 505us (828us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788658741.795426:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000020:00080000:3.0:1788658741.795429:0:18951:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788658741.797442:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797461:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797469:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797475:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacd600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.797480:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797488:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797515:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:1.0:1788658741.797519:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.797524:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.797531:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacd600/0xf657f176650ec778 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658741.803819:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.803950:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598272 00000100:00100000:3.0:1788658741.803962:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598272 00000100:00100000:3.0:1788658741.804033:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1788658741.804044:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+15:17448:x1875544076598272:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:3.0:1788658741.804070:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.804091:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec77f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3f3 expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.804177:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec77f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3f3 expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.804193:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec77f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3f3 expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.804213:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.804216:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658741.804220:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacc600, rc 0) 00000100:00100000:3.0:1788658741.804296:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+16:17448:x1875544076598272:12345-192.168.202.3@tcp:101:dd.0 Request processed in 252us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.804303:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1788658741.818583:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.818746:0:18937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598528 00000100:00100000:0.0:1788658741.818756:0:18937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598528 00000100:00100000:0.0:1788658741.818829:0:18937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658741.818840:0:18937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e15d94-c398-4038-931d-96e7c6453e92+16:17448:x1875544076598528:12345-192.168.202.3@tcp:103:dd.0 00010000:00010000:0.0:1788658741.818856:0:18937:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658741.818881:0:18937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec77f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3f3 expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658741.818902:0:18937:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:0.0:1788658741.818907:0:18937:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658741.818976:0:18937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700568380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:18e15d94-c398-4038-931d-96e7c6453e92+15:17448:x1875544076598528:12345-192.168.202.3@tcp:103:dd.0 Request processed in 137us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.818983:0:18937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658741.821364:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.821449:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598656 00000100:00100000:3.0:1788658741.821457:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598656 00000100:00100000:3.0:1788658741.821520:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:3.0:1788658741.821530:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+15:17448:x1875544076598656:12345-192.168.202.3@tcp:58:dd.0 00010000:00010000:3.0:1788658741.821631:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.821648:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.821661:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658741.822418:0:18951:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788658741.822579:0:18951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788658741.822650:0:18951:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788658741.822786:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+15:17448:x1875544076598656:12345-192.168.202.3@tcp:58:dd.0 Request processed in 1254us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.822795:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:1.0:1788658741.825793:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.825939:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598784 00000100:00100000:3.0:1788658741.825950:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598784 00000100:00100000:3.0:1788658741.826011:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1788658741.826021:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+15:17448:x1875544076598784:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:3.0:1788658741.826043:0:18953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.826063:0:18953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b3fa expref: -99 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826121:0:18953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826132:0:18953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826150:0:18953:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826163:0:18953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826175:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.826178:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788658741.826181:0:18953:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 16 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.826208:0:18953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacda00, rc 0) 00000100:00100000:3.0:1788658741.826282:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+16:17448:x1875544076598784:12345-192.168.202.3@tcp:101:dd.0 Request processed in 262us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.826289:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000040:00080000:0.0:1788658741.852939:0:18984:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788658741.852952:0:18984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658741.853028:0:18984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788658741.853040:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788658741.853166:0:18984:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac61180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18984:1875544103847424:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788658741.853294:0:18984:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ca6cb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788658741.858565:0:18984:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac61180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18984:1875544103847424:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788658741.861929:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.862194:0:18962:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076598912 00000100:00100000:1.0:1788658741.862204:0:18962:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076598912 00000100:00100000:1.0:1788658741.862268:0:18962:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658741.862280:0:18962:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076598912:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788658741.862368:0:18962:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076598912:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.862394:0:18962:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1788658741.867972:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.868116:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076599040 00000100:00100000:3.0:1788658741.868127:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076599040 00000100:00100000:3.0:1788658741.868187:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658741.868198:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076599040:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788658741.868244:0:18951:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788658741.868371:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076599040:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 174us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658741.868379:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1788658741.872407:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.872590:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076599168 00000100:00100000:1.0:1788658741.872600:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076599168 00000100:00100000:1.0:1788658741.872705:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:1.0:1788658741.872716:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076599168:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788658741.872791:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872810:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872825:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872856:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872864:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872871:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872896:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872903:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872911:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788658741.872966:0:18953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788658741.872970:0:18953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788658741.872986:0:18953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.872998:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873004:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873017:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873022:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.873027:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873293:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873306:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69b00) 00010000:00010000:1.0:1788658741.873309:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.873314:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873320:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873335:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873351:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873357:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873362:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34c00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.873366:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873373:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873380:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9e56c3c59100) 00010000:00010000:1.0:1788658741.873383:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.873386:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873391:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec79b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873407:0:18953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873412:0:18953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873417:0:18953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873423:0:18953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.873431:0:18953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873437:0:18953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873445:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:1.0:1788658741.873448:0:18953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.873451:0:18953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.873457:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7a2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658741.874414:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076599168:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 1693us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.874427:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1788658741.882620:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.882783:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076599424 00000100:00100000:3.0:1788658741.882795:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076599424 00000100:00100000:3.0:1788658741.882869:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:3.0:1788658741.882880:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:17449:x1875544076599424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788658741.882902:0:18951:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788658741.882922:0:18951:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b401 expref: -99 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883036:0:18951:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883071:0:18951:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883083:0:18951:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788658741.883288:0:18951:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788658741.883391:0:18951:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883400:0:18951:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883406:0:18951:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883412:0:18951:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658741.883416:0:18951:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883424:0:18951:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883436:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:3.0:1788658741.883439:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658741.883443:0:18951:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883449:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc600/0xf657f176650ec7b0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883496:0:18951:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7a9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b401 expref: 18 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883513:0:18951:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9e56c3c69b00) 00010000:00010000:3.0:1788658741.883516:0:18951:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788658741.883520:0:18951:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b401 expref: 18 pid: 18951 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.883530:0:18951:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56deacde00, rc 0) 00000100:00100000:3.0:1788658741.883960:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+17:17449:x1875544076599424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1080us (1351us total) trans 12884901905 rc 301/301 00000100:00100000:3.0:1788658741.883969:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:0.0:1788658741.888582:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.888887:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076599552 00000100:00100000:1.0:1788658741.888899:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076599552 00000100:00100000:1.0:1788658741.888959:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1788658741.888970:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+17:17449:x1875544076599552:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788658741.889009:0:20166:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788658741.889136:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+17:17449:x1875544076599552:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 168us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.889145:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:0.0:1788658741.894112:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.894988:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076599808 00000100:00100000:1.0:1788658741.895002:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076599808 00000100:00100000:1.0:1788658741.895183:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:1.0:1788658741.895194:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+17:17449:x1875544076599808:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658741.895244:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658741.895268:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7be lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b408 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788658741.898937:0:18952:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:1.0:1788658741.898950:0:18952:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788658741.899002:0:18952:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788658741.900718:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec7c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.900739:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec7c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.900751:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec7c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.900820:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7be lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b408 expref: 20 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.900851:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec7c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b408 expref: 19 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.900860:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59100) 00010000:00010000:1.0:1788658741.900863:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788658741.900866:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34c00, rc 0) 00000100:00100000:1.0:1788658741.900930:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+19:17449:x1875544076599808:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 5737us (6832us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788658741.900939:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1788658741.918152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.918206:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600064 00000100:00100000:1.0:1788658741.918231:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600064 00000100:00100000:1.0:1788658741.918350:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:1.0:1788658741.918363:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+19:17449:x1875544076600064:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788658741.918425:0:20166:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788658741.918453:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34c00/0xf657f176650ec7c5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b408 expref: 19 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918476:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59100) 00010000:00010000:1.0:1788658741.918498:0:20166:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788658741.918537:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918561:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918572:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918590:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918598:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918605:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918880:0:20166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918889:0:20166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918902:0:20166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918908:0:20166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35000 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.918912:0:20166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918921:0:20166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918930:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9e56c3c69c00) 00010000:00010000:1.0:1788658741.918933:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.918938:0:20166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918944:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35000/0xf657f176650ec7d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918955:0:20166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918961:0:20166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918966:0:20166:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918971:0:20166:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35600 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658741.918974:0:20166:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918990:0:20166:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.918998:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x97dac01f (ffff9e56c3c59400) 00010000:00010000:1.0:1788658741.919001:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658741.919004:0:20166:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.919020:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35600/0xf657f176650ec7da lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x97dac01f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658741.919252:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+18:17449:x1875544076600064:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 889us (1109us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788658741.919261:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1788658741.924270:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.924471:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600192 00000100:00100000:1.0:1788658741.924490:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600192 00000100:00100000:1.0:1788658741.924560:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:1.0:1788658741.924581:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+18:17449:x1875544076600192:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788658741.924606:0:20166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788658741.924629:0:20166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec7e1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b40f expref: -99 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924697:0:20166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec7e8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924713:0:20166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec7e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924724:0:20166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec7e8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924849:0:20166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec7e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b40f expref: 20 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924881:0:20166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34e00/0xf657f176650ec7e8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b40f expref: 19 pid: 20166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658741.924889:0:20166:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:1.0:1788658741.924892:0:20166:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658741.924896:0:20166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56eed34e00, rc 0) 00000100:00100000:1.0:1788658741.924949:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+19:17449:x1875544076600192:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 372us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.924966:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1788658741.934038:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.934206:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600448 00000100:00100000:3.0:1788658741.934217:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600448 00000100:00100000:3.0:1788658741.934289:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1788658741.934301:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+19:17449:x1875544076600448:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788658741.934388:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.934407:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.934419:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788658741.935388:0:18953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788658741.935405:0:18953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 633074738914ns, next at 634074735963ns, rc = 0 00000004:00010000:3.0:1788658741.935500:0:18953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004743d586 reply state 0000000099215e25 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658741.935534:0:18953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788658741.936391:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+21:17449:x1875544076600448:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 2086us (2370us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788658741.936402:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00010000:00010000:3.0:1788658741.941218:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941250:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941258:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941264:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacde00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:3.0:1788658741.941269:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941277:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941294:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:3.0:1788658741.941296:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788658741.941301:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658741.941307:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacde00/0xf657f176650ec7ef lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658741.945560:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658741.947309:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600576 00000100:00100000:2.0:1788658741.947326:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600576 00000100:00100000:2.0:1788658741.947400:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1788658741.947413:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+20:17449:x1875544076600576:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658741.947440:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658741.947464:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b416 expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.947551:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 21 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.947582:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 21 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.947604:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:2.0:1788658741.947607:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658741.947611:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cca00, rc 0) 00000100:00100000:2.0:1788658741.947701:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+21:17449:x1875544076600576:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 291us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.947708:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:0.0:1788658741.950346:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.950570:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600704 00000100:00100000:3.0:1788658741.950581:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600704 00000100:00080000:1.0:1788658741.950660:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788658741.950713:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1788658741.950728:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+5:2352:x1875544076600704:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788658741.951338:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+6:2352:x1875544076600704:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 612us (1002us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788658741.951347:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1788658741.954060:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658741.954122:0:18955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076600960 00000100:00100000:3.0:1788658741.954134:0:18955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076600960 00000100:00100000:3.0:1788658741.954205:0:18955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1788658741.954215:0:18955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+21:17449:x1875544076600960:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788658741.954726:0:18955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:18e15d94-c398-4038-931d-96e7c6453e92+22:17449:x1875544076600960:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 510us (678us total) trans 12884901908 rc 0/0 00000100:00100000:3.0:1788658741.954744:0:18955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1788658741.957516:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658741.957592:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601216 00000100:00100000:1.0:1788658741.957602:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601216 00000100:00100000:1.0:1788658741.957715:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1788658741.957725:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+22:17449:x1875544076601216:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788658741.957834:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+22:17449:x1875544076601216:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 110us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658741.957842:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:0.0:1788658741.960373:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658741.960484:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601344 00000100:00100000:2.0:1788658741.960495:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601344 00000100:00100000:2.0:1788658741.961198:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1788658741.961210:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+22:17449:x1875544076601344:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658741.961242:0:18952:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658741.961266:0:18952:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec7fd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b41d expref: -99 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961351:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961392:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961404:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788658741.961443:0:18952:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788658741.961465:0:18952:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961491:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec7fd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b41d expref: 24 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961510:0:18952:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b41d expref: 23 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.961518:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:2.0:1788658741.961522:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788658741.961526:0:18952:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3ccc00, rc 0) 00000100:00100000:2.0:1788658741.961598:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+23:17449:x1875544076601344:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 390us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.961606:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:1.0:1788658741.964901:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658741.965052:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601472 00000100:00100000:2.0:1788658741.965061:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601472 00000100:00100000:2.0:1788658741.965124:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:2.0:1788658741.965135:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e15d94-c398-4038-931d-96e7c6453e92+6:2352:x1875544076601472:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658741.965153:0:19637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658741.965186:0:19637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b424 expref: -99 pid: 19637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788658741.965213:0:19637:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9cc435, blocks: 0x1 00010000:00010000:2.0:1788658741.965241:0:19637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=633s v=(0 0) 00010000:00010000:2.0:1788658741.965246:0:19637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658741.965256:0:19637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 7 pid: 19637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.965276:0:19637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 7 pid: 19637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658741.965291:0:19637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cde00, rc 0) 00000100:00100000:2.0:1788658741.965352:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e15d94-c398-4038-931d-96e7c6453e92+7:2352:x1875544076601472:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 219us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658741.965359:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658741.967879:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.968037:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601728 00000100:00100000:0.0:1788658741.968047:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601728 00000100:00100000:0.0:1788658741.968113:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1788658741.968124:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+23:17449:x1875544076601728:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788658741.968226:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:18e15d94-c398-4038-931d-96e7c6453e92+23:17449:x1875544076601728:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 103us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658741.968244:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1788658741.972280:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658741.972452:0:18951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601856 00000100:00100000:0.0:1788658741.972463:0:18951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601856 00000100:00100000:0.0:1788658741.972551:0:18951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:0.0:1788658741.972564:0:18951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+23:17449:x1875544076601856:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788658742.009426:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901906 is committed 00000001:00080000:2.0:1788658742.009445:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901908 is committed 00000004:00080000:2.0:1788658742.009453:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788658742.009777:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788658742.009794:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103847552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788658742.009860:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658742.009926:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103847552 00000100:00100000:2.0:1788658742.009934:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103847552 00000100:00100000:2.0:1788658742.009980:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788658742.009990:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103847552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788658742.010373:0:19638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788658742.010390:0:19638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788658742.010393:0:19638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788658742.010395:0:19638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788658741 -> 1788658741 00002000:00010000:2.0:1788658742.010398:0:19638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788658742.010448:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875544103847552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 460us (586us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788658742.010457:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1788658742.010715:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9e57005abb80/2, rc 0, transno 12884901891 00000100:00100000:1.0:1788658742.010723:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103847552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788658742.010930:0:18951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:18e15d94-c398-4038-931d-96e7c6453e92+14:17449:x1875544076601856:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 38366us (38692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658742.010940:0:18951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:1.0:1788658742.014265:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658742.014403:0:19637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076601984 00000100:00100000:2.0:1788658742.014413:0:19637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076601984 00000100:00100000:2.0:1788658742.014629:0:19637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1788658742.014642:0:19637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e15d94-c398-4038-931d-96e7c6453e92+7:2353:x1875544076601984:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788658742.014846:0:19637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:18e15d94-c398-4038-931d-96e7c6453e92+7:2353:x1875544076601984:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 206us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658742.014855:0:19637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1788658742.018362:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658742.018460:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602240 00000100:00100000:3.0:1788658742.018469:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602240 00000100:00100000:2.0:1788658742.018994:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:2.0:1788658742.019007:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+14:17449:x1875544076602240:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788658742.019070:0:18953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788658742.019106:0:18953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3ccc00/0xf657f176650ec804 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b41d expref: 14 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.019128:0:18953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:2.0:1788658742.019134:0:18953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788658742.019163:0:18953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.019190:0:18953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.019200:0:18953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788658742.019607:0:18953:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d890a60 reply state 00000000dffdfc36 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.019618:0:18953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788658742.019759:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+15:17449:x1875544076602240:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 755us (1407us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788658742.019766:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00080000:1.0:1788658742.020285:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788658742.023530:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1788658742.023712:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023726:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023733:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023739:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658742.023744:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023750:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023767:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:1.0:1788658742.023770:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658742.023775:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.023780:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec812 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.023874:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602368 00000100:00100000:2.0:1788658742.023884:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602368 00000100:00100000:2.0:1788658742.023937:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1788658742.023946:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+7:17449:x1875544076602368:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788658742.023964:0:19638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788658742.023980:0:19638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6a7a9f6f91c8b42b expref: -99 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.024008:0:19638:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 8 pid: 19637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.024026:0:19638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.024030:0:19638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.024036:0:19638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 8 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.024086:0:19638:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 8 pid: 19637 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.024111:0:19638:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 8 pid: 19637 timeout: 733 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.024126:0:19638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19638:1875544103847680:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658742.024248:0:19638:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788658742.027769:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.027836:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602496 00000100:00100000:0.0:1788658742.027864:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602496 00010000:00010000:0.0:1788658742.027904:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 9 pid: 19637 timeout: 733 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.027953:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1788658742.027963:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+9:2351:x1875544076602496:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658742.027977:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658742.027999:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 9 pid: 19637 timeout: 733 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.028020:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 9 pid: 19637 timeout: 733 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.028046:0:18936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.028050:0:18936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.028056:0:18936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.028066:0:18936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.028117:0:18936:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.028131:0:18936:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e56fac62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18936:1875544103847808:192.168.202.3@tcp:105: 00000100:00100000:0.0:1788658742.028207:0:18936:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56ca6cb000 going to sleep for 11 seconds 00010000:00010000:3.0:1788658742.031401:0:19638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085f01ba1/0xf657f176650ec80b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b424 expref: 9 pid: 19637 timeout: 733 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.031423:0:19638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19638:1875544103847680:192.168.202.3@tcp:104: 00010000:00010000:3.0:1788658742.031453:0:19638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 8 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.031464:0:19638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9e56ff3cc000, rc 0) 00000100:00100000:2.0:1788658742.031609:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+8:17449:x1875544076602368:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 7662us (8091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658742.031619:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1788658742.031876:0:18936:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e56fac62300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:18936:1875544103847808:192.168.202.3@tcp:105: 00010000:00010000:2.0:1788658742.031889:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788658742.031916:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+7:2351:x1875544076602496:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3955us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658742.031924:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658742.035118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658742.035209:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602624 00000100:00100000:3.0:1788658742.035219:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602624 00000100:00100000:3.0:1788658742.035291:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1788658742.035302:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e15d94-c398-4038-931d-96e7c6453e92+7:2352:x1875544076602624:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788658742.035748:0:20273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788658742.035752:0:20273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788658741 00002000:00010000:3.0:1788658742.035755:0:20273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788658740 00002000:00010000:3.0:1788658742.035770:0:20273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788658741 -> 1788658741 00002000:00010000:3.0:1788658742.035773:0:20273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788658742.035841:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:18e15d94-c398-4038-931d-96e7c6453e92+8:2352:x1875544076602624:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 540us (736us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788658742.035850:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1788658742.038522:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658742.040600:0:19639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602752 00000100:00100000:2.0:1788658742.040619:0:19639:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602752 00000100:00100000:2.0:1788658742.040750:0:19639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:2.0:1788658742.040761:0:19639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+8:2354:x1875544076602752:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788658742.040810:0:19639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.040850:0:19639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 8 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.040859:0:19639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.040863:0:19639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788658742.040868:0:19639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.040914:0:19639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 8 pid: 19638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.040928:0:19639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 8 pid: 19638 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.040942:0:19639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19639:1875544103847936:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658742.041039:0:19639:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658742.045918:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.046074:0:19639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19639:1875544103847936:192.168.202.3@tcp:104: 00010000:00010000:0.0:1788658742.046180:0:19639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.046658:0:18938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076602880 00000100:00100000:3.0:1788658742.046768:0:18938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076602880 00010000:00010000:3.0:1788658742.046813:0:18938:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.046909:0:18938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1788658742.046919:0:18938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+9:2351:x1875544076602880:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788658742.046935:0:18938:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788658742.046961:0:18938:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.046975:0:18938:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.046998:0:18938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d254dc64/0xf657f176650ec819 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b42b expref: 9 pid: 19638 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.047018:0:18938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658742.047023:0:18938:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788658742.047029:0:18938:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.047058:0:18938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.047098:0:18938:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788658742.047169:0:18938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:18e15d94-c398-4038-931d-96e7c6453e92+8:2351:x1875544076602880:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 251us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658742.047178:0:18938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:0.0:1788658742.047304:0:19639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047313:0:19639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047336:0:19639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047344:0:19639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047352:0:19639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047359:0:19639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cc800 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.047364:0:19639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047373:0:19639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047397:0:19639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.047403:0:19639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000035ceef/0xf657f176650ec820 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.047454:0:19639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:18e15d94-c398-4038-931d-96e7c6453e92+7:2354:x1875544076602752:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 6695us (8943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658742.047461:0:19639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1788658742.050558:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658742.050644:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603136 00000100:00100000:2.0:1788658742.050654:0:18952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603136 00000100:00100000:2.0:1788658742.050744:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:2.0:1788658742.050756:0:18952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+14:17449:x1875544076603136:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788658742.050837:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.050854:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.050881:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.051361:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.051373:0:18952:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 15 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.051381:0:18952:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.051414:0:18952:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 15 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.051427:0:18952:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 15 pid: 18952 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.051442:0:18952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18952:1875544103848064:192.168.202.3@tcp:104: 00000100:00100000:2.0:1788658742.051520:0:18952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765780 going to sleep for 11 seconds 00000100:00100000:2.0:1788658742.054327:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.054415:0:18936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603264 00000100:00100000:0.0:1788658742.054424:0:18936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603264 00010000:00010000:0.0:1788658742.054465:0:18936:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 16 pid: 18952 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.054508:0:18936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1788658742.054518:0:18936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:2352:x1875544076603264:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788658742.054532:0:18936:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788658742.054540:0:18936:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 16 pid: 18952 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.054554:0:18936:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 16 pid: 18952 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.054577:0:18936:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:0.0:1788658742.054582:0:18936:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.054608:0:18936:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.054616:0:18936:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.054635:0:18936:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788658742.054726:0:18936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:18e15d94-c398-4038-931d-96e7c6453e92+16:2352:x1875544076603264:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 208us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658742.054734:0:18936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:1.0:1788658742.058500:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cca00/0xf657f176650ec7f6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b416 expref: 15 pid: 18952 timeout: 733 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658742.058609:0:18952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18952:1875544103848064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1788658742.058635:0:18952:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.058646:0:18952:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.058652:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788658742.059066:0:18952:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901910 00000001:00080000:1.0:1788658742.059294:0:18952:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901911 00000001:00080000:1.0:1788658742.059337:0:18952:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000100:00100000:1.0:1788658742.059423:0:18952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700422a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18952:1875544103848192:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788658742.059523:0:18952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788658742.059878:0:18952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56d08c2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788658742.060039:0:18956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848192 00000100:00100000:0.0:1788658742.060047:0:18956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848192 00000100:00100000:0.0:1788658742.060196:0:18956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788658742.060207:0:18956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fabd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18952:x1875544103848192:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788658742.060319:0:18956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fabd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18952:x1875544103848192:12345-0@lo:1000:mdt00_001.0 Request processed in 114us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658742.060327:0:18956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788658742.060407:0:18952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700422a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18952:1875544103848192:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788658742.061165:0:18952:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000100:00100000:2.0:1788658742.061247:0:18952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18952:1875544103848320:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788658742.061306:0:18952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788658742.062099:0:18952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765840 going to sleep for 11 seconds 00000100:00100000:1.0:1788658742.062212:0:18957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848320 00000100:00100000:1.0:1788658742.062220:0:18957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848320 00000100:00100000:1.0:1788658742.062267:0:18957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788658742.062276:0:18957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18952:x1875544103848320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788658742.062603:0:18957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18952:x1875544103848320:12345-0@lo:1000:mdt00_001.0 Request processed in 265us (1234us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788658742.062613:0:18957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788658742.062954:0:18952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18952:1875544103848320:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788658742.063003:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063013:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063021:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063026:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd400 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658742.063031:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063038:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063052:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:2.0:1788658742.063056:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658742.063060:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063065:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cd400/0xf657f176650ec82e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063108:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063115:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063120:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063135:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56deacc800 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:2.0:1788658742.063138:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063144:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063152:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:2.0:1788658742.063154:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788658742.063162:0:18952:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063173:0:18952:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063182:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.063216:0:18952:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacda00/0xf657f176650ec78d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0x6a7a9f6f91c8b3fa expref: 18 pid: 18953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.063228:0:18952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e57005aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18952:1875544103848448:192.168.202.3@tcp:105: 00000100:00100000:2.0:1788658742.063304:0:18952:0:(client.c:2716:ptlrpc_set_wait()) set ffff9e56c9765840 going to sleep for 11 seconds 00000100:00100000:2.0:1788658742.066718:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.066903:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603392 00000100:00100000:0.0:1788658742.066913:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603392 00000100:00100000:0.0:1788658742.066974:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1788658742.066985:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+19:17448:x1875544076603392:12345-192.168.202.3@tcp:49:dd.0 00000100:00100000:0.0:1788658742.067260:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+19:17448:x1875544076603392:12345-192.168.202.3@tcp:49:dd.0 Request processed in 276us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658742.067268:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1788658742.070940:0:18952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e57005aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18952:1875544103848448:192.168.202.3@tcp:105: 00010000:00010000:1.0:1788658742.070977:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071180:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56deacc800/0xf657f176650ec786 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18951 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071217:0:18952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071230:0:18952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071252:0:18952:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071265:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071271:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071277:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071282:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed35200 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658742.071285:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071292:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071302:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:1.0:1788658742.071305:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788658742.071309:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071321:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed35200/0xf657f176650ec835 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071331:0:18952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071336:0:18952:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071342:0:18952:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071347:0:18952:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cdc00 already unused, calling callback (ffffffffc204e4f0) 00010000:00010000:1.0:1788658742.071350:0:18952:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071356:0:18952:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071363:0:18952:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9e56c3c69900) 00010000:00010000:1.0:1788658742.071365:0:18952:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788658742.071368:0:18952:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.071374:0:18952:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56ff3cdc00/0xf657f176650ec827 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18952 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788658742.071956:0:18952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:18e15d94-c398-4038-931d-96e7c6453e92+18:17449:x1875544076603136:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 21198us (21407us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788658742.071968:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000020:00080000:1.0:1788658742.071981:0:18952:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788658742.078940:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658742.079060:0:18954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603648 00000100:00100000:1.0:1788658742.079071:0:18954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603648 00000100:00100000:1.0:1788658742.079129:0:18954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1788658742.079139:0:18954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56ff377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+18:17449:x1875544076603648:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788658742.079892:0:18954:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788658742.080003:0:18954:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00010000:00010000:1.0:1788658742.080053:0:18954:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080070:0:18954:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080081:0:18954:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080091:0:18954:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080097:0:18954:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080103:0:18954:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.080118:0:18954:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788658742.080214:0:18954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56ff377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:18e15d94-c398-4038-931d-96e7c6453e92+20:17449:x1875544076603648:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 1074us (1285us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788658742.080223:0:18954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000020:00080000:1.0:1788658742.080229:0:18954:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788658742.080637:0:18940:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788658742.080645:0:18940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.080653:0:18940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34200 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:3.0:1788658742.080657:0:18940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.080708:0:18940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.080723:0:18940:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9e56c3c59f00) 00010000:00010000:3.0:1788658742.080726:0:18940:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788658742.080731:0:18940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.080737:0:18940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9e56eed34200/0xf657f176650ec83c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18954 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788658742.080751:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658742.080753:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788658742.080755:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788658742.082404:0:18984:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788658742.082415:0:18984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788658742.082446:0:18984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788658742.082458:0:18984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788658742.095316:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658742.095362:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.095542:0:19642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603904 00000100:00100000:0.0:1788658742.095564:0:19642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603904 00000100:00100000:0.0:1788658742.095636:0:19642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076603776 00000100:00100000:0.0:1788658742.095640:0:19642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076603776 00000100:00100000:0.0:1788658742.095661:0:19642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658742.095725:0:19642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e15d94-c398-4038-931d-96e7c6453e92+8:2351:x1875544076603904:12345-192.168.202.3@tcp:4:dd.0 00002000:00010000:0.0:1788658742.095774:0:19642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a9cc435, atime: 0x6a9cc434, ctime: 0x6a9cc435, blocks: 0x1 00010000:00010000:0.0:1788658742.095783:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.095800:0:19642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=633s v=(0 0) 00010000:00010000:0.0:1788658742.095804:0:19642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.095811:0:19642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.095825:0:19642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.098926:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658742.099122:0:19644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788658742.099133:0:19644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788658742.099521:0:19644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604032 00000100:00100000:0.0:1788658742.099531:0:19644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604032 00000100:00100000:2.0:1788658742.101122:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1788658742.101151:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+10:2352:x1875544076603776:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:2.0:1788658742.101197:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.101216:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.101221:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.101228:0:21079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.101256:0:21079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658742.152330:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:2.0:1788658742.152355:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:0.0:1788658742.152586:0:19642:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1788658742.152591:0:19642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1788658742.152606:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152621:0:19642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152649:0:19642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152657:0:19642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9600 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.152662:0:19642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152706:0:19642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152727:0:19642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152735:0:19642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be8f1001/0xf657f176650ec843 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.152829:0:19642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e15d94-c398-4038-931d-96e7c6453e92+10:2351:x1875544076603904:12345-192.168.202.3@tcp:4:dd.0 Request processed in 57102us (57522us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788658742.152839:0:19642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1788658742.152874:0:19642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:0.0:1788658742.152885:0:19642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e15d94-c398-4038-931d-96e7c6453e92+9:2351:x1875544076604032:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:0.0:1788658742.152918:0:19642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152930:0:19642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.152940:0:19642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.152946:0:19642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.152958:0:19642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658742.190615:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00002000:00010000:2.0:1788658742.191080:0:21079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788658742.191086:0:21079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1788658742.191100:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191115:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191124:0:21079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191131:0:21079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658742.191136:0:21079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191155:0:21079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191174:0:21079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.191182:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec84a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.191279:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+9:2352:x1875544076603776:12345-192.168.202.3@tcp:4:dd.0 Request processed in 90131us (95910us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788658742.191289:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00002000:00010000:0.0:1788658742.224497:0:19642:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1788658742.224524:0:19642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224539:0:19642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224560:0:19642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224568:0:19642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.224573:0:19642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224583:0:19642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224601:0:19642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.224609:0:19642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec851 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.224798:0:19642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:18e15d94-c398-4038-931d-96e7c6453e92+7:2351:x1875544076604032:12345-192.168.202.3@tcp:4:dd.0 Request processed in 71910us (125878us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788658742.224808:0:19642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000001:00080000:3.0:1788658742.225536:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00000100:00100000:2.0:1788658742.230186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.230462:0:19644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604160 00000100:00100000:0.0:1788658742.230472:0:19644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604160 00000100:00100000:1.0:1788658742.230645:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1788658742.230850:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:18e15d94-c398-4038-931d-96e7c6453e92+5:2353:x1875544076604160:12345-192.168.202.3@tcp:4:dd.0 00002000:00010000:1.0:1788658742.230904:0:19643:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 3145728, mtime: 0x6a9cc435, atime: 0x6a9cc434, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788658742.230913:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.230930:0:19643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=633s v=(0 0) 00010000:00010000:1.0:1788658742.230935:0:19643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788658742.230941:0:19643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788658742.230957:0:19643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.232608:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658742.234459:0:21079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604288 00000100:00100000:2.0:1788658742.234476:0:21079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604288 00000100:00100000:2.0:1788658742.234618:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1788658742.234629:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+7:2353:x1875544076604288:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:2.0:1788658742.235265:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.235287:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.235292:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.235299:0:21079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.235314:0:21079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.240379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1788658742.240415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.240947:0:19644:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788658742.240959:0:19644:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788658742.240986:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788658742.240993:0:19642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604416 00000100:00100000:0.0:1788658742.241012:0:19642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604416 00000100:00100000:0.0:1788658742.241067:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788658742.241072:0:19642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604544 00000100:00100000:0.0:1788658742.241075:0:19642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604544 00000100:00100000:3.0:1788658742.251611:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1788658742.254386:0:19642:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788658742.254407:0:19642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604672 00000100:00100000:0.0:1788658742.254417:0:19642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604672 00000100:00100000:0.0:1788658742.263286:0:21081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1788658742.263305:0:21081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:18e15d94-c398-4038-931d-96e7c6453e92+15:2354:x1875544076604416:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:0.0:1788658742.263346:0:21081:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.263364:0:21081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.263368:0:21081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.263376:0:21081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.263389:0:21081:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788658742.299480:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:2.0:1788658742.300280:0:19643:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1788658742.300288:0:19643:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 0 -> 1788658741 00002000:00010000:2.0:1788658742.300291:0:19643:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788658742.300306:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300320:0:19643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300330:0:19643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300337:0:19643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56eed34400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658742.300342:0:19643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300352:0:19643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300373:0:19643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300381:0:19643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092a14c67/0xf657f176650ec858 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788658742.300500:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:18e15d94-c398-4038-931d-96e7c6453e92+15:2353:x1875544076604160:12345-192.168.202.3@tcp:4:dd.0 Request processed in 69649us (70322us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788658742.300511:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:2.0:1788658742.300622:0:19643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:2.0:1788658742.300635:0:19643:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e570056a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:18e15d94-c398-4038-931d-96e7c6453e92+14:2354:x1875544076604544:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:2.0:1788658742.300887:0:19643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300901:0:19643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.300906:0:19643:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788658742.300913:0:19643:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.300926:0:19643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788658742.349098:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:0.0:1788658742.349209:0:21079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1788658742.349215:0:21079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1788658742.349230:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349258:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349268:0:21079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349274:0:21079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cd400 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.349279:0:21079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349288:0:21079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349308:0:21079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349315:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034a176a1/0xf657f176650ec85f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.349411:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+12:2353:x1875544076604288:12345-192.168.202.3@tcp:4:dd.0 Request processed in 114779us (116810us total) trans 12884901898 rc 0/0 00000100:00100000:0.0:1788658742.349432:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:0.0:1788658742.349464:0:21079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:0.0:1788658742.349476:0:21079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+11:2353:x1875544076604672:12345-192.168.202.3@tcp:4:dd.0 00010000:00010000:0.0:1788658742.349514:0:21079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349527:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.349531:0:21079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788658742.349539:0:21079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349553:0:21079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349908:0:21081:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349918:0:21081:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349926:0:21081:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349932:0:21081:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d8a00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.349936:0:21081:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349958:0:21081:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349970:0:21081:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.349977:0:21081:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087edb638/0xf657f176650ec866 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.351201:0:21081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:18e15d94-c398-4038-931d-96e7c6453e92+11:2354:x1875544076604416:12345-192.168.202.3@tcp:4:dd.0 Request processed in 87888us (110837us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788658742.351213:0:21081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000001:00080000:2.0:1788658742.382845:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:0.0:1788658742.382899:0:19643:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788658742.382904:0:19643:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1788658742.382918:0:19643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.382932:0:19643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.382941:0:19643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.382948:0:19643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e56ff3cda00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:0.0:1788658742.382953:0:19643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.382978:0:19643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.382999:0:19643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788658742.383007:0:19643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008988c060/0xf657f176650ec86d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788658742.383103:0:19643:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e570056a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:18e15d94-c398-4038-931d-96e7c6453e92+9:2354:x1875544076604544:12345-192.168.202.3@tcp:4:dd.0 Request processed in 82466us (142680us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788658742.383112:0:19643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000001:00080000:3.0:1788658742.426081:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:2.0:1788658742.426421:0:21079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788658742.426436:0:21079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426450:0:21079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426475:0:21079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426482:0:21079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9e57021d9c00 already unused, calling callback (ffffffffc160a4f0) 00010000:00010000:2.0:1788658742.426487:0:21079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426497:0:21079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426519:0:21079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788658742.426528:0:21079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bc133cf/0xf657f176650ec874 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788658742.427140:0:21079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e5700569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:18e15d94-c398-4038-931d-96e7c6453e92+5:2353:x1875544076604672:12345-192.168.202.3@tcp:4:dd.0 Request processed in 77658us (175536us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788658742.427171:0:21079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00010000:00010000:3.0:1788658742.498181:0:18939:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788658743.197002:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788658743.197033:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103848576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788658743.197106:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658743.197287:0:19641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848576 00000100:00100000:3.0:1788658743.197295:0:19641:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848576 00000100:00100000:3.0:1788658743.197368:0:19641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658743.197380:0:19641:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103848576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788658743.197417:0:19641:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788658743.197476:0:19641:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875544103848576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658743.197484:0:19641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788658743.197941:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788658743.197984:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875544103848576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788658743.198857:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103848832:0@lo:400:kworker.0 00000100:00100000:3.0:1788658743.198902:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788658743.198943:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788658743.198950:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103848960:0@lo:400:kworker.0 00000100:00100000:3.0:1788658743.198976:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658743.199168:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103849088:0@lo:400:kworker.0 00000100:00100000:0.0:1788658743.199198:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658743.199216:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788658743.199221:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103848704:0@lo:400:kworker.0 00000100:00100000:0.0:1788658743.199261:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658743.199289:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103849216:0@lo:400:kworker.0 00000100:00100000:0.0:1788658743.199310:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788658743.199341:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848960 00000100:00100000:0.0:1788658743.199349:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848960 00000100:00100000:0.0:1788658743.199388:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103849088 00000100:00100000:0.0:1788658743.199391:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103849088 00000100:00100000:0.0:1788658743.199411:0:20166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103849216 00000100:00100000:0.0:1788658743.199414:0:20166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103849216 00000100:00100000:0.0:1788658743.199429:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658743.199443:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103848960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788658743.199500:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875544103848960:12345-0@lo:400:kworker.0 Request processed in 57us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658743.199506:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788658743.199523:0:20166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788658743.199530:0:20166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103849088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658743.200145:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875544103848960:0@lo:400:kworker.0 00000100:00100000:3.0:1788658743.200178:0:20273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848832 00000100:00100000:3.0:1788658743.200182:0:20273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848832 00000100:00100000:3.0:1788658743.200220:0:20273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658743.200228:0:20273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e55c2401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103848832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788658743.200291:0:20273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e55c2401500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875544103848832:12345-0@lo:400:kworker.0 Request processed in 64us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658743.200297:0:20273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788658743.200323:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:3.0:1788658743.200329:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9e57005abb80, transno 12884901891 00000004:00080000:3.0:1788658743.200339:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:3.0:1788658743.200356:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875544103848832:0@lo:400:kworker.0 00000100:00100000:2.0:1788658743.200878:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788658743.200889:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103849216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788658743.200936:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56eec5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875544103849216:12345-0@lo:400:kworker.0 Request processed in 51us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658743.200950:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788658743.201455:0:18945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544103848704 00000100:00100000:1.0:1788658743.201463:0:18945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544103848704 00000100:00100000:1.0:1788658743.201500:0:18945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788658743.201508:0:18945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103848704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788658743.201550:0:18945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7533a2-f0ee-43c1-8561-a2cc551aa877+19:3306:x1875544103848704:12345-0@lo:400:kworker.0 Request processed in 43us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.201556:0:18945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788658743.201594:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788658743.201600:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788658743.201626:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e5700568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4b7533a2-f0ee-43c1-8561-a2cc551aa877:3306:1875544103848704:0@lo:400:kworker.0 00000100:00100000:1.0:1788658743.201640:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2403100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875544103849216:0@lo:400:kworker.0 00000100:00100000:0.0:1788658743.201973:0:20166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56fac62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875544103849088:12345-0@lo:400:kworker.0 Request processed in 2442us (2773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788658743.201982:0:20166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788658743.203374:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9e55c2401880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875544103849088:0@lo:400:kworker.0 00010000:00010000:2.0:1788658743.516912:0:20274:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788658743.751539:0:21119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1788658743.978335:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658743.978385:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658743.978418:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658743.978448:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658743.978469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658743.978483:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076605056 00000100:00100000:2.0:1788658743.978487:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1788658743.978495:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076605056 00000100:00100000:2.0:1788658743.978510:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1788658743.978534:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076605312 00000100:00100000:2.0:1788658743.978537:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076605312 00000100:00100000:2.0:1788658743.978574:0:18953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604928 00000100:00100000:2.0:1788658743.978577:0:18953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604928 00000100:00100000:2.0:1788658743.978600:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1788658743.978610:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:2351:x1875544076605312:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658743.978621:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076605568 00000100:00100000:1.0:1788658743.978625:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076605568 00000100:00100000:1.0:1788658743.978639:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076605184 00000100:00100000:1.0:1788658743.978641:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076605184 00000100:00100000:1.0:1788658743.978651:0:19638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076605440 00000100:00100000:1.0:1788658743.978653:0:19638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076605440 00000100:00100000:1.0:1788658743.978691:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658743.978698:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076605056:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658743.978830:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076605056:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 131us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.978838:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:1.0:1788658743.978855:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1788658743.978861:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076605568:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658743.978890:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076605568:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.978896:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1788658743.978907:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658743.978913:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076605184:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1788658743.978934:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:18e15d94-c398-4038-931d-96e7c6453e92+5:2351:x1875544076605184:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.978941:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1788658743.978952:0:19638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:2.0:1788658743.978954:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:96c834a5-fc33-426e-b9d6-5502955248d0+6:2351:x1875544076605312:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 345us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.978957:0:19638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076605440:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658743.978961:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1788658743.978973:0:18953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1788658743.978977:0:18953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+20:2351:x1875544076604928:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1788658743.978997:0:18953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:18e15d94-c398-4038-931d-96e7c6453e92+20:2351:x1875544076604928:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 20us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788658743.978997:0:19638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e57005aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:96c834a5-fc33-426e-b9d6-5502955248d0+5:2351:x1875544076605440:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 39us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788658743.979003:0:18953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:1.0:1788658743.979155:0:19638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1788658743.979167:0:18946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875544076604800 00000100:00100000:3.0:1788658743.979171:0:18946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875544076604800 00000100:00100000:3.0:1788658743.979213:0:18946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:3.0:1788658743.979221:0:18946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9e56e5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:2351:x1875544076604800:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1788658743.979261:0:18946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9e56e5c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3d29274b-714d-4f7c-845d-b6bb1e24047c+13:2351:x1875544076604800:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 41us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788658743.979267:0:18946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00080000:1.0:1788658743.979429:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788658743.979435:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788658743.979438:0:18947:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788658744.542465:0:18940:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9527 lines, 9527 kept, 0 dropped, 0 bad.